-- Logs begin at Tue 2022-07-12 12:46:30 UTC, end at Tue 2022-07-12 13:42:33 UTC. -- Jul 12 13:18:24.601879 dv-cinder-820027-10-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 12 13:18:24.612885 dv-cinder-820027-10-iscsi devstack@n-api.service[103270]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 12 13:18:24.613427 dv-cinder-820027-10-iscsi devstack@n-api.service[103270]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jul 12 13:18:24 2022] *** Jul 12 13:18:24.613427 dv-cinder-820027-10-iscsi devstack@n-api.service[103270]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 12 13:18:24.613427 dv-cinder-820027-10-iscsi devstack@n-api.service[103270]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 12 13:18:24.613427 dv-cinder-820027-10-iscsi devstack@n-api.service[103270]: nodename: dv-cinder-820027-10-iscsi Jul 12 13:18:24.613427 dv-cinder-820027-10-iscsi devstack@n-api.service[103270]: machine: x86_64 Jul 12 13:18:24.613427 dv-cinder-820027-10-iscsi devstack@n-api.service[103270]: clock source: unix Jul 12 13:18:24.613427 dv-cinder-820027-10-iscsi devstack@n-api.service[103270]: pcre jit disabled Jul 12 13:18:24.613427 dv-cinder-820027-10-iscsi devstack@n-api.service[103270]: detected number of CPU cores: 4 Jul 12 13:18:24.613427 dv-cinder-820027-10-iscsi devstack@n-api.service[103270]: current working directory: / Jul 12 13:18:24.613427 dv-cinder-820027-10-iscsi devstack@n-api.service[103270]: detected binary path: /usr/bin/uwsgi-core Jul 12 13:18:24.613427 dv-cinder-820027-10-iscsi devstack@n-api.service[103270]: your processes number limit is 47680 Jul 12 13:18:24.613427 dv-cinder-820027-10-iscsi devstack@n-api.service[103270]: your memory page size is 4096 bytes Jul 12 13:18:24.613427 dv-cinder-820027-10-iscsi devstack@n-api.service[103270]: detected max file descriptor number: 2048 Jul 12 13:18:24.613427 dv-cinder-820027-10-iscsi devstack@n-api.service[103270]: lock engine: pthread robust mutexes Jul 12 13:18:24.613427 dv-cinder-820027-10-iscsi devstack@n-api.service[103270]: thunder lock: enabled Jul 12 13:18:24.614398 dv-cinder-820027-10-iscsi devstack@n-api.service[103270]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 12 13:18:24.614398 dv-cinder-820027-10-iscsi devstack@n-api.service[103270]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 12 13:18:24.657096 dv-cinder-820027-10-iscsi devstack@n-api.service[103270]: Python main interpreter initialized at 0x556d5fc009c0 Jul 12 13:18:24.657096 dv-cinder-820027-10-iscsi devstack@n-api.service[103270]: python threads support enabled Jul 12 13:18:24.657096 dv-cinder-820027-10-iscsi devstack@n-api.service[103270]: your server socket listen backlog is limited to 100 connections Jul 12 13:18:24.657096 dv-cinder-820027-10-iscsi devstack@n-api.service[103270]: your mercy for graceful operations on workers is 90 seconds Jul 12 13:18:24.657465 dv-cinder-820027-10-iscsi devstack@n-api.service[103270]: mapped 403077 bytes (393 KB) for 2 cores Jul 12 13:18:24.657608 dv-cinder-820027-10-iscsi devstack@n-api.service[103270]: *** Operational MODE: preforking *** Jul 12 13:18:24.657873 dv-cinder-820027-10-iscsi devstack@n-api.service[103270]: *** uWSGI is running in multiple interpreter mode *** Jul 12 13:18:24.657873 dv-cinder-820027-10-iscsi devstack@n-api.service[103270]: spawned uWSGI master process (pid: 103270) Jul 12 13:18:24.658065 dv-cinder-820027-10-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 12 13:18:24.658802 dv-cinder-820027-10-iscsi devstack@n-api.service[103270]: spawned uWSGI worker 1 (pid: 103271, cores: 1) Jul 12 13:18:24.658944 dv-cinder-820027-10-iscsi devstack@n-api.service[103270]: spawned uWSGI worker 2 (pid: 103272, cores: 1) Jul 12 13:18:24.659098 dv-cinder-820027-10-iscsi devstack@n-api.service[103270]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 12 13:18:25.319894 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 12 13:18:25.322480 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 12 13:18:26.445995 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 12 13:18:26.445995 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: from cryptography.utils import int_from_bytes Jul 12 13:18:26.446601 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 12 13:18:26.446601 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: from cryptography.utils import int_from_bytes Jul 12 13:18:26.453681 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 12 13:18:26.453681 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: from cryptography.utils import int_from_bytes Jul 12 13:18:26.454143 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 12 13:18:26.454143 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: from cryptography.utils import int_from_bytes Jul 12 13:18:28.938060 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 12 13:18:28.938625 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 12 13:18:28.938824 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 12 13:18:28.939182 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 12 13:18:28.939436 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 12 13:18:28.940073 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.940397 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.940720 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.940914 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 12 13:18:28.941280 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.941414 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 12 13:18:28.941500 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.941670 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.941782 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 12 13:18:28.941983 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.942081 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 12 13:18:28.942294 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.942381 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 12 13:18:28.942615 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.942719 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.942874 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.943020 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.943187 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.943351 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.943507 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-820027-10-iscsi {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.943679 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.943824 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.944014 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.944127 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.944333 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.944418 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.944658 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.944751 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.944983 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.945071 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.945315 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.945430 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.945612 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.945707 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.945934 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.946134 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.946533 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-820027-10-iscsi {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.946684 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.946801 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.946913 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.947019 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.947135 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.947240 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.947458 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.947579 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.947767 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.947871 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.948071 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.948158 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.948385 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.948471 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.948688 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.948932 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.949104 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.949362 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.949553 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.949873 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.949971 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-820027-10-iscsi {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.950258 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.950358 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.950569 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.950673 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.950882 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.950981 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.951238 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.951331 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.951569 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.951662 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.951879 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.951977 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.952198 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.952330 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.952513 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.952612 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.952815 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.952908 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-820027-10-iscsi {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.953136 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.953230 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.953472 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.953577 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.953791 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.953879 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.954106 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.954272 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.954405 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.954591 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.955017 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.955217 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.955306 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.955527 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.955613 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.955850 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.955937 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.956156 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.956256 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.956459 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.956546 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.956709 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.956805 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.957019 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.957114 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.957337 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.957440 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.957746 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.957845 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.958002 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.958106 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.958252 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.958339 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.958499 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.958621 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.958816 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.958947 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.959132 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.959268 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.959440 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.959538 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.959747 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.959834 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.960052 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.960138 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.960358 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.960445 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.960660 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.960746 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.960922 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.961055 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.961244 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.961356 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.961574 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.961670 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.961890 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.961988 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.962203 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.962310 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.962517 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.962611 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.962821 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.962913 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.963131 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.963225 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.963447 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.963540 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.23 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.963755 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.23 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.963847 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.964073 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.964378 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.964478 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.964744 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.964895 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.965057 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.965246 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.965367 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.965533 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.965716 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.965849 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.966117 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.23 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.966242 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.966376 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.23 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.966464 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.966692 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.966786 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.967037 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.967134 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.967360 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.967447 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.967674 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.967758 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.967981 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.968076 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.968229 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.968317 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.968529 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.968634 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.968834 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.968921 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.969147 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.969234 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.969479 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.969581 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.969786 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.969873 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.970092 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.970317 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.970403 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.970578 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.970677 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.970932 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.971074 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.971250 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.971336 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.971557 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.971643 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.971863 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.971957 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.972163 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.972258 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.972470 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.972560 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.972771 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.972858 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.973071 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.973164 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.973428 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.973530 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.973726 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.973812 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.974031 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.974124 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.974338 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.974436 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.974642 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.974947 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.975032 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.975261 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.975541 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.975637 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.975858 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.976117 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.976211 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.976476 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.976693 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.976780 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.977080 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.977275 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.977437 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.977608 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.977765 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.977916 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.978087 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.978231 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.978375 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.978548 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.978714 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.978863 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.979008 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.979153 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.979374 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.979532 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.979676 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.979832 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.979973 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.980638 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.980823 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.981015 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.981329 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.981479 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.981658 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.981861 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.981950 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.982186 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.982274 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.982508 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.982595 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.982838 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.982924 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.983149 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.983237 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.983454 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.983539 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.983763 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.983859 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.984255 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.984375 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.984573 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.984911 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:28.985007 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.985245 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:28.985552 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.985664 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:28.985911 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:28.986145 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.986243 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:28.986552 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:28.986717 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.986866 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:28.987099 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.987378 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:28.987467 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.987694 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:28.987860 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.988019 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:28.988330 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:28.988419 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.988640 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:28.988948 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:28.989033 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.989268 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:28.989613 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:28.989711 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.989940 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:28.990222 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.990310 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:28.990555 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:28.990811 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.990905 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:28.991245 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.991363 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:28.991586 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:18:28.991680 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:28.991940 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:28.992027 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:28.992288 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:28.992376 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:28.992601 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:28.992687 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:28.992941 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:28.993113 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:28.993282 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:28.993708 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:28.993874 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:28.994199 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:28.994343 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:28.994520 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:28.994828 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:28.994951 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:28.995136 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:28.995442 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:28.995536 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:28.995911 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:28.996655 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:28.996785 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:28.997100 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:28.997296 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:28.997434 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:28.997752 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:28.997936 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:28.998071 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:28.998382 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:28.998502 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:28.998694 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:28.999005 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:28.999098 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:28.999341 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:28.999654 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:28.999744 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:28.999965 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.000062 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.000277 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.000486 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.000617 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.000832 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.000935 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.001184 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.001308 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.001518 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.001824 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.001911 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.002127 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.002247 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.002427 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.002590 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.002734 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.002939 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.003036 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.003336 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.003434 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.003659 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.003749 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.003960 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.004097 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.004287 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.004459 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.004587 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.004795 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.004894 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.005134 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.005222 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.005493 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.005585 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.005796 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.005896 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.006105 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.006193 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.006409 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.006503 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.006707 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.006807 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.007026 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.007114 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.007332 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.007420 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.007634 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.007730 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.007960 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.008115 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.008263 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.008444 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.008564 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.008767 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.008874 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.009090 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.009177 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.009433 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.009535 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.009785 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.009872 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.010088 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.010174 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.010407 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.010507 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.010720 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.010888 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.011030 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.011399 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.011492 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.011777 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.011943 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.012079 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.012242 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.012401 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.012572 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.012727 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.012893 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.013042 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.013208 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.013344 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.013550 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.013678 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.013869 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.013984 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.014182 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.014270 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.014572 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.014659 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.014879 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.015132 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.015218 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.015465 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.015630 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.015766 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.015861 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.016066 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.016181 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.016367 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.016502 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.016684 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.016822 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.016988 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.017139 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.017288 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.017476 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.017613 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.017858 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.017945 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.018248 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.018344 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.018550 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.018806 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.018893 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.019163 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.019249 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.019486 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.019573 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.019802 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.019893 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.020121 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.020219 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.020434 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.020521 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.020742 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.020830 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.021054 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.021149 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.021364 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.021502 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.021698 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.021968 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.022067 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.022314 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.022409 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.022633 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.022727 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.022940 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.023027 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.023260 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.023347 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.023567 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.023654 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.023887 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.023974 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.024187 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.024313 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.024500 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.024635 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.024835 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.024969 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.025165 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.025305 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.025517 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.025657 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.025838 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.025970 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.026150 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.026286 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.026461 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.026599 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.026767 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.026911 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.027156 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.027278 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.027468 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.027593 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.027780 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.027901 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.028103 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.028211 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.028413 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.028505 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.028730 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.028818 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.029038 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.029125 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.029356 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.029474 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.029689 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.029824 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.030007 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.030095 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.030308 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.030404 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.030617 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.030705 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.030943 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.031029 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.031256 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.031343 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.031564 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.031651 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.031875 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.031963 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.032196 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.032296 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.032503 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.032597 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.032807 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.032893 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.033114 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.033215 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.033439 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.033530 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.033745 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.033832 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.034050 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.034153 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.034363 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.034463 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.034669 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.034755 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.034972 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.035069 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.035274 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.035362 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.035583 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.035671 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.035887 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.035975 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.036187 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.036283 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.036489 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.036584 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.036800 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.036887 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.037116 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.037209 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.037448 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.037557 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.037769 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.037858 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.038090 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.038177 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.038392 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.038480 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.038692 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.038783 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.039010 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.039098 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.039315 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.039555 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.039651 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.039904 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.040000 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.040201 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.040296 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.040538 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.040626 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.040844 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.041067 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.041153 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.041422 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.041525 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.041772 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.041865 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.042078 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.042176 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.042387 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.042481 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.043245 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.043358 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.043562 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.043726 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.043858 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.044045 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.044170 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.044366 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.044476 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.044700 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.044842 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.045040 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.045131 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.045354 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.045490 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.045716 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.045885 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.046034 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.046133 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.046341 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.046439 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.046650 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.046746 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.046960 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.047048 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.047260 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.047355 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.047568 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.047662 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.047879 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.047964 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.048197 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.048463 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.048558 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.048800 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.048898 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.049113 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.049205 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.049452 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.049559 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.049766 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.049852 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.050079 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.050178 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.050385 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.050485 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.050704 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.050791 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.051030 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.051118 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.051339 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.051433 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.051648 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.051737 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.051954 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.052086 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.052257 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.052344 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.052562 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.052654 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.052864 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.052958 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.053167 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.053255 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.053496 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.053598 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.053807 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.053893 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.054105 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.054199 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.054406 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.054500 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.054706 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.054796 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.055007 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.055103 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.055321 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.055409 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.055623 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.055710 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.055934 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.056033 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.056235 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.056323 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.056553 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.056639 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.056858 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.056953 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.057159 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.057253 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.057485 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.057578 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.057789 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.057878 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.058129 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.058228 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.059025 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.059153 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.059309 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.059424 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.059619 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.059730 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.059948 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.060051 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.060263 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.060366 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.060578 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.060675 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.060895 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.060991 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.061202 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.061288 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.061545 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.061636 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.061870 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.061975 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.062180 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.062447 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.062541 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.062772 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.062863 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.063083 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.063174 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.063428 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.063523 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.063693 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.063780 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.063999 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.064098 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.064300 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.064391 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.064858 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.064960 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.065160 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.065251 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.065494 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.065607 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.065802 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.065893 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.066102 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.066202 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.066401 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.066499 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.066708 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.066799 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.067012 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.067114 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.067312 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.067403 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.067616 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.067713 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.067916 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.068013 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.068225 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.068315 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.068534 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.068625 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.068835 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.068932 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.069137 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.069228 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.069467 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.069559 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.069775 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.069865 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.070073 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.070163 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.070387 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.070553 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.070700 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.070792 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.071004 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.071089 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.071305 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.071405 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.071608 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.071698 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.071907 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.071996 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.072261 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.072370 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.072506 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.072591 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.072828 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.072929 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.073142 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.073251 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.073538 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.073641 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.073779 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.073953 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.074158 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.074255 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.074487 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.074582 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.074796 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.074890 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.075103 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.075203 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.075405 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.075500 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.075707 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.075801 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.076006 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.076108 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.076306 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.076402 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.076604 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.076707 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.076918 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.077011 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.077222 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.077316 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.077558 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.077664 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.077857 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.077951 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.078158 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.078244 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.078461 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.078558 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.078779 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.078865 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.079093 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.079179 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.079403 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.079501 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.079711 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.079805 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.080023 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.080107 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.080332 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.080428 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.080639 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.080726 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.080946 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.081031 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.081248 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.081342 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.081592 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.081681 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.081899 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.081984 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.082205 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.082307 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.082510 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.082608 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.082808 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.082909 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.083116 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.083209 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.083423 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.083510 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.083735 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.083831 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.084048 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.084134 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.084356 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.084449 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.084664 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.084759 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.084962 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.085055 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.085309 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.085434 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.085600 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.085703 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.085908 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.085993 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.086214 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.086300 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.086518 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.086613 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.086827 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.086914 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.087138 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.087223 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.087446 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.087539 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.087751 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.087843 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.088060 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.088144 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.088369 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.088457 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.088674 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.088759 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.088977 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.089064 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.089280 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.089366 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.089636 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.089790 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.089951 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.090068 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.090277 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.090384 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.090592 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.090692 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.090899 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.090988 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.091208 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.091296 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.091517 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.091605 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.091865 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.091962 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.092172 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.092260 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.092534 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.092631 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.092834 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.092932 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.093146 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.093233 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.093487 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.093578 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.093804 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.093901 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.094117 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.094206 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.094419 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.094506 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.094735 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.094830 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.095057 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.095144 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.095376 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.095463 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.095694 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.095790 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.096003 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.096090 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.096301 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.096393 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.096612 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.096701 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.096926 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.097012 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.097226 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.097312 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.097555 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.097645 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.097856 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.097945 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.098178 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.098265 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.098478 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.098566 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.098795 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.098890 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.099121 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.099206 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.099432 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.099522 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.099744 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.099839 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.100060 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.100216 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.100378 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.100524 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.100695 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.100824 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.101011 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.101148 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.101327 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.101571 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.101671 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.101791 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.101966 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.102063 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.102278 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.102366 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.102601 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.102689 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.102899 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.103006 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.103224 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.103315 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.103538 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.103626 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.103848 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.104009 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.104149 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.104302 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.104448 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.104587 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.104757 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.104890 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.105061 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.105731 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.105949 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.106245 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.106499 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.106589 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.106825 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.106925 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.107137 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.107236 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.107455 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.107543 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.107781 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.107869 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.108085 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.108180 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.108386 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.108473 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.108698 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.108793 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.109002 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.109136 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.109302 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.109485 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.109650 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.109809 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.109953 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.110128 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.110264 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.110432 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.110574 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.110736 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.110881 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.111055 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.111183 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.111385 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.111472 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.111695 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.111789 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.112004 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.112092 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.112313 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.112400 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.112655 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.112790 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.112949 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.113050 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.113274 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.113361 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.113609 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.113726 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.113928 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.114074 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.114235 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.114324 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.114539 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.114744 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.114839 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.115072 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.115167 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.115388 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.115475 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.115716 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.115803 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.116044 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.116131 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.116369 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.116456 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.116679 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.116776 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.116984 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.117079 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.117302 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.117407 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.117651 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.117750 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.117964 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.118051 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.118279 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.118367 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.118595 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.118690 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.118898 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.118985 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.119200 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.119288 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.119507 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.119603 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.119809 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.119897 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.120109 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.120200 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.120409 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.120554 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.120714 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.121424 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.121764 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.121866 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.122083 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.122171 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.122387 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.122476 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.122708 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.122795 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.123007 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.123138 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.123318 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.123405 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.123623 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.123719 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.123927 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.124016 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.124229 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.124319 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.124529 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.124671 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.124859 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.124945 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.125159 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.125254 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.125505 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.125608 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.125815 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.125913 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.126126 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.126221 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.126452 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.126548 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.126759 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.126845 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.127083 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.127170 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.127399 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.127493 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.127717 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.127806 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.128034 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.128122 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.128341 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.128435 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.128654 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.128740 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.128965 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.129051 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.129274 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.129369 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.129606 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.129693 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.129914 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.130012 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.130226 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.130313 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.130538 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.130625 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.130867 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.131056 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.131200 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.131383 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.131533 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.131847 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.132019 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.132183 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.132341 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.132512 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.132656 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.132831 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.132955 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.133151 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.133275 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.133505 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.133607 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.133816 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.133904 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.134122 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.134258 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.134434 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.134522 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.134750 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.135058 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.135145 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.135365 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.135452 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.135676 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.135764 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.135983 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.136071 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.136290 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.136394 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.136723 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.136812 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.137034 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.137122 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.137347 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.137473 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.137728 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.137837 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.138045 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.138139 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.138351 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.138445 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.138669 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.138769 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.138983 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.139071 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.139295 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.139384 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.139607 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.139708 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.139919 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.140007 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.140229 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.140326 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.140539 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.140630 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.140849 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.140937 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.141156 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.141244 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.141490 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.141583 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.141803 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.141890 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.142125 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.142214 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.142455 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.142544 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.142772 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.142860 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.143083 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.143170 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.143395 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.143484 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.143708 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.143795 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.144019 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.144223 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.144360 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.144536 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.144653 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.144864 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.144995 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.145186 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.145519 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.145627 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.145832 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.145919 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.146149 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.146245 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.146466 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.146553 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.146766 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.146851 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.147067 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.147155 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.147373 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.147461 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.147679 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.147767 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.147982 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.148070 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.148294 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.148379 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.148605 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.148692 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.148908 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.148997 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.149223 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.149310 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.149556 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.149645 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.149916 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.150088 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.150238 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.150433 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.150557 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.150748 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.150875 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.151069 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.151193 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.151391 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.151555 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.151707 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.151878 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.152061 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.152272 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.152380 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.152609 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.152698 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.152935 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.153023 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.153254 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.153342 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.153592 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.153691 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.153896 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.153986 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.154197 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.154285 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.154506 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.154594 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.154812 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.154904 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.155113 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.155207 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.155418 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.155513 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.155719 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.155820 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.156048 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.156147 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.156351 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.156438 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.156651 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.156745 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.156952 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.157049 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.157264 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.157352 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.157592 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.157684 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.157893 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.158147 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.158236 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.158466 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.158554 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.158787 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.158873 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.159088 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.159189 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.159394 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.159481 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.159694 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.159793 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.160004 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.160091 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.160306 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.160393 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.160613 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.160713 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.160948 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.161034 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.161263 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.161351 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.161591 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.161690 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.161893 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.162025 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.162206 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.162295 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.162513 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.162608 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.162819 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.162913 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.163126 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.163211 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.163436 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.163525 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.163778 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.163971 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.164089 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.164328 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.164619 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.164714 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.164955 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.165043 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.165276 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.165364 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.165624 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.165711 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.165935 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.166023 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.166246 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.166341 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.166550 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.166638 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.166855 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.166942 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.167170 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.167265 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.167478 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.167565 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.168320 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.168420 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.168630 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.168845 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.168933 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.169177 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.169264 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.169525 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.169618 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.169839 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.169934 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.170145 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.170232 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.170451 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.170612 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.170755 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.170844 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.171058 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.171146 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.171363 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.171459 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.171670 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.171767 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.171979 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.172106 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.172286 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.172386 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.172597 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.172686 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.172907 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.172995 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.173214 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.173303 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.173555 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.173677 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.173862 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.173948 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.174166 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.174260 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.174470 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.174555 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.174774 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.174864 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.175089 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.175177 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.175399 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.175492 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.175709 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.175807 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.176010 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.176098 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.176361 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.176448 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.176670 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.176766 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.176991 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.177085 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.177306 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.177426 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.177642 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.177742 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.177960 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.178049 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.178274 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.178360 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.178581 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.178680 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.178900 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.178988 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.179211 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.179454 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.179549 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.179794 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.179881 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.180122 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.180209 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.180460 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.180560 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.180759 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.180845 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.181060 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.181148 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.181360 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.181481 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.181687 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.181776 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.182001 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.182088 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.182309 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.182414 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.182609 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.182697 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.182909 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.182997 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.183217 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.183929 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.184147 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.184294 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.184486 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.184613 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.184797 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.184934 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.185102 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.185225 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.185431 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.185577 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.185742 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.185872 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.186041 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.186139 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.186342 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.186436 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.186642 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.186731 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.186944 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.187032 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.187244 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.187339 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.187549 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.187636 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.187851 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.187938 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.188199 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.188301 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.188451 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.188547 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.188751 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.188847 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.189058 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.189158 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.189416 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.189764 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.189996 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.190084 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.190309 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.190397 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.190629 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.190725 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.190941 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.191029 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.191247 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.191333 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.191556 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.191686 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.191927 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.192018 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.192251 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.192339 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.192566 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.192691 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.192872 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.192963 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.193200 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.193295 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.193535 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.193638 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.193851 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.193948 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.194163 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.194252 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.194471 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.194567 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.194781 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.194923 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.195091 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.195179 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.195418 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.195506 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.195748 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.195845 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.196054 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.196141 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.196364 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.196451 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.196672 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.196761 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.196984 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.197080 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.197295 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.197430 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.197632 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.197722 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.197937 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.198037 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.198245 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.198379 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.198548 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.198636 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.198853 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.198959 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.199208 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.199303 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.199519 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.199607 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.199832 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.199920 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.200147 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.200311 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.200470 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.200558 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.200790 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.200878 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.201098 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.201195 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.201427 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.201517 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.201739 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.201837 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.202049 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.202149 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.202362 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.202451 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.202671 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.202748 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.202979 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.203079 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.203286 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.203374 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.203596 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.203722 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.203905 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.203996 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.204179 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 12 13:18:29.204279 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.204570 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.204890 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.205218 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.205567 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.205899 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.206215 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.206544 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.206871 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.207192 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.207508 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.207845 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.208165 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.208488 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.208810 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.209127 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.209473 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.209792 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.210129 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.210468 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.210782 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.211111 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.211436 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.211760 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.212081 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.212401 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.212735 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.213054 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.213367 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.213715 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.214040 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.214358 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.214775 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.215125 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.215456 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.215790 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.216106 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.216437 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.216768 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.217124 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.217471 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.217824 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.218162 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.218482 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.218803 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.219115 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:18:29.219362 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 12 13:18:29.265604 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: INFO dbcounter [None req-3ef30a34-be9c-47b8-a12c-249e890acf1d None None] Registered counter for database nova_api Jul 12 13:18:29.282929 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: INFO dbcounter [None req-04706b2d-cbea-4ad1-a62c-7c146fb98f39 None None] Registered counter for database nova_api Jul 12 13:18:29.379196 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG oslo_db.sqlalchemy.engines [None req-3ef30a34-be9c-47b8-a12c-249e890acf1d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103271) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 13:18:29.385695 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG dbcounter [-] [103271] Writer thread running {{(pid=103271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 13:18:29.399109 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG oslo_db.sqlalchemy.engines [None req-04706b2d-cbea-4ad1-a62c-7c146fb98f39 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103272) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 13:18:29.406228 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG dbcounter [-] [103272] Writer thread running {{(pid=103272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 13:18:29.442016 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.context [None req-3ef30a34-be9c-47b8-a12c-249e890acf1d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1699b324-b37f-4b24-822a-271bd58456f2(cell1) {{(pid=103271) load_cells /opt/stack/nova/nova/context.py:464}} Jul 12 13:18:29.445881 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG oslo_concurrency.lockutils [None req-3ef30a34-be9c-47b8-a12c-249e890acf1d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:29.447452 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG oslo_concurrency.lockutils [None req-3ef30a34-be9c-47b8-a12c-249e890acf1d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:29.448237 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG oslo_concurrency.lockutils [None req-3ef30a34-be9c-47b8-a12c-249e890acf1d None None] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:29.450362 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG oslo_concurrency.lockutils [None req-3ef30a34-be9c-47b8-a12c-249e890acf1d None None] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:29.452308 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: INFO dbcounter [None req-3ef30a34-be9c-47b8-a12c-249e890acf1d None None] Registered counter for database nova_cell0 Jul 12 13:18:29.456114 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: INFO dbcounter [None req-3ef30a34-be9c-47b8-a12c-249e890acf1d None None] Registered counter for database nova_cell1 Jul 12 13:18:29.462145 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.context [None req-04706b2d-cbea-4ad1-a62c-7c146fb98f39 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1699b324-b37f-4b24-822a-271bd58456f2(cell1) {{(pid=103272) load_cells /opt/stack/nova/nova/context.py:464}} Jul 12 13:18:29.463471 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG oslo_db.sqlalchemy.engines [None req-3ef30a34-be9c-47b8-a12c-249e890acf1d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103271) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 13:18:29.465742 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG oslo_db.sqlalchemy.engines [None req-3ef30a34-be9c-47b8-a12c-249e890acf1d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103271) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 13:18:29.467004 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG oslo_concurrency.lockutils [None req-04706b2d-cbea-4ad1-a62c-7c146fb98f39 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:29.468601 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG oslo_concurrency.lockutils [None req-04706b2d-cbea-4ad1-a62c-7c146fb98f39 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:29.469435 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG oslo_concurrency.lockutils [None req-04706b2d-cbea-4ad1-a62c-7c146fb98f39 None None] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:29.471123 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG dbcounter [-] [103271] Writer thread running {{(pid=103271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 13:18:29.471562 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG oslo_concurrency.lockutils [None req-04706b2d-cbea-4ad1-a62c-7c146fb98f39 None None] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:29.473543 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG dbcounter [-] [103271] Writer thread running {{(pid=103271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 13:18:29.473666 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: INFO dbcounter [None req-04706b2d-cbea-4ad1-a62c-7c146fb98f39 None None] Registered counter for database nova_cell0 Jul 12 13:18:29.477524 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: INFO dbcounter [None req-04706b2d-cbea-4ad1-a62c-7c146fb98f39 None None] Registered counter for database nova_cell1 Jul 12 13:18:29.485433 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG oslo_db.sqlalchemy.engines [None req-04706b2d-cbea-4ad1-a62c-7c146fb98f39 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103272) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 13:18:29.488907 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG oslo_db.sqlalchemy.engines [None req-04706b2d-cbea-4ad1-a62c-7c146fb98f39 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103272) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 13:18:29.490951 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG dbcounter [-] [103272] Writer thread running {{(pid=103272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 13:18:29.619716 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: INFO dbcounter [None req-3ef30a34-be9c-47b8-a12c-249e890acf1d None None] Registered counter for database nova_cell0 Jul 12 13:18:29.626683 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG oslo_db.sqlalchemy.engines [None req-3ef30a34-be9c-47b8-a12c-249e890acf1d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103271) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 13:18:29.630893 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG dbcounter [-] [103271] Writer thread running {{(pid=103271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 13:18:29.634256 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG dbcounter [-] [103272] Writer thread running {{(pid=103272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 13:18:29.644275 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: INFO dbcounter [None req-04706b2d-cbea-4ad1-a62c-7c146fb98f39 None None] Registered counter for database nova_cell0 Jul 12 13:18:29.654439 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG oslo_db.sqlalchemy.engines [None req-04706b2d-cbea-4ad1-a62c-7c146fb98f39 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103272) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 13:18:29.667857 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG dbcounter [-] [103272] Writer thread running {{(pid=103272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 13:18:29.973384 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: WARNING keystonemiddleware.auth_token [None req-3ef30a34-be9c-47b8-a12c-249e890acf1d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 12 13:18:29.980679 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: WARNING keystonemiddleware.auth_token [None req-3ef30a34-be9c-47b8-a12c-249e890acf1d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 12 13:18:29.984618 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: WARNING keystonemiddleware.auth_token [None req-04706b2d-cbea-4ad1-a62c-7c146fb98f39 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 12 13:18:29.991929 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: WARNING keystonemiddleware.auth_token [None req-04706b2d-cbea-4ad1-a62c-7c146fb98f39 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 12 13:18:30.333076 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: WARNING keystonemiddleware.auth_token [None req-3ef30a34-be9c-47b8-a12c-249e890acf1d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 12 13:18:30.336075 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: WARNING keystonemiddleware.auth_token [None req-04706b2d-cbea-4ad1-a62c-7c146fb98f39 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 12 13:18:30.339433 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: WARNING keystonemiddleware.auth_token [None req-3ef30a34-be9c-47b8-a12c-249e890acf1d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 12 13:18:30.343400 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: WARNING keystonemiddleware.auth_token [None req-04706b2d-cbea-4ad1-a62c-7c146fb98f39 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 12 13:18:30.345285 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x556d5fc009c0 pid: 103271 (default app) Jul 12 13:18:30.347383 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-3ef30a34-be9c-47b8-a12c-249e890acf1d None None] Calling method '>' {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:18:30.348573 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-3ef30a34-be9c-47b8-a12c-249e890acf1d None None] 10.222.0.23 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001740 Jul 12 13:18:30.348720 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x556d5fc009c0 pid: 103272 (default app) Jul 12 13:18:30.348989 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 1/1] 10.222.0.23 () {50 vars in 788 bytes} [Tue Jul 12 13:18:30 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:19:46.392931 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-04706b2d-cbea-4ad1-a62c-7c146fb98f39 None None] Calling method '>' {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:19:46.394250 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-04706b2d-cbea-4ad1-a62c-7c146fb98f39 None None] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002057 Jul 12 13:19:46.394649 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 1/2] 10.222.0.23 () {54 vars in 930 bytes} [Tue Jul 12 13:19:46 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:19:46.406370 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG dbcounter [-] [103271] Writing DB stats nova_api:SELECT=3 {{(pid=103271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:19:46.407483 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG dbcounter [-] [103271] Writing DB stats nova_cell1:SELECT=3 {{(pid=103271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:19:46.408202 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG dbcounter [-] [103271] Writing DB stats nova_cell0:SELECT=3 {{(pid=103271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:19:46.409113 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG dbcounter [-] [103271] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:19:47.273453 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-ecd03de1-92e0-4a1c-b5f6-43148941c309 admin admin] Calling method '>' {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:19:47.303404 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-ecd03de1-92e0-4a1c-b5f6-43148941c309 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.902338 Jul 12 13:19:47.304066 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 2/3] 10.222.0.23 () {60 vars in 1291 bytes} [Tue Jul 12 13:19:46 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:19:49.557970 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-04706b2d-cbea-4ad1-a62c-7c146fb98f39 None None] Calling method '>' {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:19:49.558841 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-04706b2d-cbea-4ad1-a62c-7c146fb98f39 None None] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001540 Jul 12 13:19:49.559235 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 2/4] 10.222.0.23 () {54 vars in 930 bytes} [Tue Jul 12 13:19:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:19:50.031519 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-f70feac1-5da0-4c57-a5e4-d78e58fba62e admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "ram": 256, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "cirros256", "swap": 0, "rxtx_factor": 1.0, "id": "c1", "vcpus": 1}} {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:19:50.049708 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 13:19:50.049708 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: warnings.warn(msg) Jul 12 13:19:50.081474 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-f70feac1-5da0-4c57-a5e4-d78e58fba62e admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.516048 Jul 12 13:19:50.089945 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 3/5] 10.222.0.23 () {64 vars in 1282 bytes} [Tue Jul 12 13:19:49 2022] POST /compute/v2.1/flavors => generated 407 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 13:19:50.096779 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG dbcounter [-] [103272] Writing DB stats nova_api:SELECT=3 {{(pid=103272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:19:50.097770 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG dbcounter [-] [103272] Writing DB stats nova_cell0:SELECT=3 {{(pid=103272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:19:50.098687 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG dbcounter [-] [103272] Writing DB stats nova_cell1:SELECT=3 {{(pid=103272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:19:50.099409 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG dbcounter [-] [103272] Writing DB stats nova_cell0:SELECT=3 {{(pid=103272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:19:50.304439 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-6d6a6bce-3613-4a38-a207-0746485c587a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:19:50.306906 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 13:19:50.306906 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: warnings.warn(msg) Jul 12 13:19:50.372887 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-6d6a6bce-3613-4a38-a207-0746485c587a admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.281628 Jul 12 13:19:50.373819 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 3/6] 10.222.0.23 () {64 vars in 1335 bytes} [Tue Jul 12 13:19:50 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:19:52.647832 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-f70feac1-5da0-4c57-a5e4-d78e58fba62e admin admin] Calling method '>' {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:19:52.648895 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-f70feac1-5da0-4c57-a5e4-d78e58fba62e admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001509 Jul 12 13:19:52.649299 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 4/7] 10.222.0.23 () {54 vars in 930 bytes} [Tue Jul 12 13:19:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:19:53.323568 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-5f169217-888c-419f-88a8-74531e29b8df admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 5, "rxtx_factor": 1.0, "vcpus": 1, "os-flavor-access:is_public": true, "name": "ds512M", "swap": 0, "id": "d1", "ram": 512}} {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:19:53.341165 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 13:19:53.341165 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: warnings.warn(msg) Jul 12 13:19:53.363759 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-5f169217-888c-419f-88a8-74531e29b8df admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.706695 Jul 12 13:19:53.364871 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 4/8] 10.222.0.23 () {64 vars in 1282 bytes} [Tue Jul 12 13:19:52 2022] POST /compute/v2.1/flavors => generated 404 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 13:19:53.377153 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-36a8de68-d3be-4dc3-88da-c2df3c48b647 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:19:53.378644 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 13:19:53.378644 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: warnings.warn(msg) Jul 12 13:19:53.415099 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-36a8de68-d3be-4dc3-88da-c2df3c48b647 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041598 Jul 12 13:19:53.423855 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 5/9] 10.222.0.23 () {64 vars in 1335 bytes} [Tue Jul 12 13:19:53 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:19:55.668143 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-5f169217-888c-419f-88a8-74531e29b8df admin admin] Calling method '>' {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:19:55.668143 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-5f169217-888c-419f-88a8-74531e29b8df admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001572 Jul 12 13:19:55.668143 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 5/10] 10.222.0.23 () {54 vars in 930 bytes} [Tue Jul 12 13:19:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 13:19:56.024835 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-b5533753-af53-47e5-81a9-9432b08a1959 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "swap": 0, "name": "ds1G", "ram": 1024, "id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 1}} {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:19:56.042831 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-b5533753-af53-47e5-81a9-9432b08a1959 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.368800 Jul 12 13:19:56.043464 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 6/11] 10.222.0.23 () {64 vars in 1282 bytes} [Tue Jul 12 13:19:55 2022] POST /compute/v2.1/flavors => generated 404 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 13:19:56.055073 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-a48d81a2-5a98-44b4-9b4c-9c2b54567779 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:19:56.078455 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-a48d81a2-5a98-44b4-9b4c-9c2b54567779 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027042 Jul 12 13:19:56.079033 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 6/12] 10.222.0.23 () {64 vars in 1335 bytes} [Tue Jul 12 13:19:56 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:19:58.407191 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-b5533753-af53-47e5-81a9-9432b08a1959 admin admin] Calling method '>' {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:19:58.408350 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-b5533753-af53-47e5-81a9-9432b08a1959 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001627 Jul 12 13:19:58.408829 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 7/13] 10.222.0.23 () {54 vars in 930 bytes} [Tue Jul 12 13:19:58 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:19:58.841709 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-8c3a8138-6dd0-4292-af8d-c92b7820b616 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 10, "ram": 2048, "vcpus": 2, "id": "d3", "os-flavor-access:is_public": true, "name": "ds2G", "rxtx_factor": 1.0}} {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:19:58.861112 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-8c3a8138-6dd0-4292-af8d-c92b7820b616 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.446290 Jul 12 13:19:58.862018 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 7/14] 10.222.0.23 () {64 vars in 1282 bytes} [Tue Jul 12 13:19:58 2022] POST /compute/v2.1/flavors => generated 404 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 13:19:58.874758 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-91f53e2c-7656-400c-ac7d-c088ce5a211d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:19:58.908465 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-91f53e2c-7656-400c-ac7d-c088ce5a211d admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038151 Jul 12 13:19:58.909062 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 8/15] 10.222.0.23 () {64 vars in 1335 bytes} [Tue Jul 12 13:19:58 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:20:01.199322 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-8c3a8138-6dd0-4292-af8d-c92b7820b616 admin admin] Calling method '>' {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:01.201012 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-8c3a8138-6dd0-4292-af8d-c92b7820b616 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002069 Jul 12 13:20:01.201563 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 8/16] 10.222.0.23 () {54 vars in 930 bytes} [Tue Jul 12 13:20:01 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:20:01.657400 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-fb8a02d4-357f-4f71-a46d-fde13020cd29 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "vcpus": 4, "id": "d4", "name": "ds4G", "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096}} {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:20:01.677159 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-fb8a02d4-357f-4f71-a46d-fde13020cd29 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.469644 Jul 12 13:20:01.677982 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 9/17] 10.222.0.23 () {64 vars in 1282 bytes} [Tue Jul 12 13:20:01 2022] POST /compute/v2.1/flavors => generated 404 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 13:20:01.689860 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-351e52dc-854c-432e-93b9-3960ea00bfc8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:20:01.713406 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-351e52dc-854c-432e-93b9-3960ea00bfc8 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027217 Jul 12 13:20:01.715055 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 9/18] 10.222.0.23 () {64 vars in 1335 bytes} [Tue Jul 12 13:20:01 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:20:04.131908 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-fb8a02d4-357f-4f71-a46d-fde13020cd29 admin admin] Calling method '>' {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:04.132957 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-fb8a02d4-357f-4f71-a46d-fde13020cd29 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001502 Jul 12 13:20:04.133366 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 10/19] 10.222.0.23 () {54 vars in 930 bytes} [Tue Jul 12 13:20:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:20:04.598524 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-ccd77c78-dd83-46f3-9865-0f3053401057 admin admin] Calling method '>' {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:04.624977 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-ccd77c78-dd83-46f3-9865-0f3053401057 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.483460 Jul 12 13:20:04.625698 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 10/20] 10.222.0.23 () {60 vars in 1291 bytes} [Tue Jul 12 13:20:04 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:20:06.977468 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-fb8a02d4-357f-4f71-a46d-fde13020cd29 admin admin] Calling method '>' {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:06.978542 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-fb8a02d4-357f-4f71-a46d-fde13020cd29 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001566 Jul 12 13:20:06.979506 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 11/21] 10.222.0.23 () {54 vars in 930 bytes} [Tue Jul 12 13:20:06 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:20:07.404333 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-2e39833e-cd3a-4b84-8ecf-b938d36ebe8f admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "name": "m1.tiny", "id": "1", "vcpus": 1, "disk": 1}} {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:20:07.425261 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-2e39833e-cd3a-4b84-8ecf-b938d36ebe8f admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.439370 Jul 12 13:20:07.426038 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 11/22] 10.222.0.23 () {64 vars in 1282 bytes} [Tue Jul 12 13:20:06 2022] POST /compute/v2.1/flavors => generated 402 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 13:20:07.438511 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-2392e141-8ea4-4bb8-a9b6-e35552e4b648 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:20:07.463530 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-2392e141-8ea4-4bb8-a9b6-e35552e4b648 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028616 Jul 12 13:20:07.464110 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 12/23] 10.222.0.23 () {64 vars in 1332 bytes} [Tue Jul 12 13:20:07 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:20:09.710858 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-2e39833e-cd3a-4b84-8ecf-b938d36ebe8f admin admin] Calling method '>' {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:09.711864 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-2e39833e-cd3a-4b84-8ecf-b938d36ebe8f admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Jul 12 13:20:09.712263 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 12/24] 10.222.0.23 () {54 vars in 930 bytes} [Tue Jul 12 13:20:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:20:10.107784 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-df5d6419-fdea-4de5-8c92-fa5350d9f9a4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "2", "vcpus": 1, "name": "m1.small", "ram": 2048, "disk": 20, "os-flavor-access:is_public": true, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:20:10.124963 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-df5d6419-fdea-4de5-8c92-fa5350d9f9a4 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.406738 Jul 12 13:20:10.125588 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 13/25] 10.222.0.23 () {64 vars in 1282 bytes} [Tue Jul 12 13:20:09 2022] POST /compute/v2.1/flavors => generated 405 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 13:20:10.137534 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-87902a37-f785-4c76-9c17-64dca703686c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:20:10.159513 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-87902a37-f785-4c76-9c17-64dca703686c admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025880 Jul 12 13:20:10.160422 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 13/26] 10.222.0.23 () {64 vars in 1332 bytes} [Tue Jul 12 13:20:10 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:20:12.428512 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-df5d6419-fdea-4de5-8c92-fa5350d9f9a4 admin admin] Calling method '>' {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:12.429564 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-df5d6419-fdea-4de5-8c92-fa5350d9f9a4 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Jul 12 13:20:12.429967 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 14/27] 10.222.0.23 () {54 vars in 930 bytes} [Tue Jul 12 13:20:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:20:12.816143 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-8b9c8f7a-46d7-4fff-be8e-99c95ebeac37 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "3", "vcpus": 2, "name": "m1.medium", "disk": 40, "ram": 4096, "rxtx_factor": 1.0}} {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:20:12.834341 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-8b9c8f7a-46d7-4fff-be8e-99c95ebeac37 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.397865 Jul 12 13:20:12.834905 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 14/28] 10.222.0.23 () {64 vars in 1282 bytes} [Tue Jul 12 13:20:12 2022] POST /compute/v2.1/flavors => generated 406 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 13:20:12.847629 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-3811eb82-4c01-44d4-87ef-c11da8ad9bdc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:20:12.877168 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-3811eb82-4c01-44d4-87ef-c11da8ad9bdc admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033361 Jul 12 13:20:12.877907 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 15/29] 10.222.0.23 () {64 vars in 1332 bytes} [Tue Jul 12 13:20:12 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:20:15.184509 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-8b9c8f7a-46d7-4fff-be8e-99c95ebeac37 admin admin] Calling method '>' {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:15.185558 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-8b9c8f7a-46d7-4fff-be8e-99c95ebeac37 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001500 Jul 12 13:20:15.186262 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 15/30] 10.222.0.23 () {54 vars in 930 bytes} [Tue Jul 12 13:20:15 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 13:20:15.648871 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-a588c85d-0880-4725-8db2-ceb46fddd443 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 80, "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "ram": 8192, "vcpus": 4, "id": "4", "name": "m1.large"}} {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:20:15.671702 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-a588c85d-0880-4725-8db2-ceb46fddd443 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.478955 Jul 12 13:20:15.673099 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 16/31] 10.222.0.23 () {64 vars in 1282 bytes} [Tue Jul 12 13:20:15 2022] POST /compute/v2.1/flavors => generated 405 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 13:20:15.686018 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-03131aa8-6533-4cf5-986b-e8f81605c07a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:20:15.712961 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-03131aa8-6533-4cf5-986b-e8f81605c07a admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031286 Jul 12 13:20:15.714169 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 16/32] 10.222.0.23 () {64 vars in 1332 bytes} [Tue Jul 12 13:20:15 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:20:18.090054 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-a588c85d-0880-4725-8db2-ceb46fddd443 admin admin] Calling method '>' {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:18.091171 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-a588c85d-0880-4725-8db2-ceb46fddd443 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001504 Jul 12 13:20:18.091576 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 17/33] 10.222.0.23 () {54 vars in 930 bytes} [Tue Jul 12 13:20:18 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:20:18.527660 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-5753663f-ea19-48f0-a23b-b2e930de8ff5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 8, "ram": 16384, "swap": 0, "id": "5", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "m1.xlarge", "disk": 160}} {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:20:18.556823 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-5753663f-ea19-48f0-a23b-b2e930de8ff5 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.459007 Jul 12 13:20:18.559005 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 17/34] 10.222.0.23 () {64 vars in 1282 bytes} [Tue Jul 12 13:20:18 2022] POST /compute/v2.1/flavors => generated 408 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 13:20:18.571082 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-d4c2c5ec-062d-4e0b-b31e-577d0f0f3a14 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:20:18.575300 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG dbcounter [-] [103271] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:20:18.599375 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-d4c2c5ec-062d-4e0b-b31e-577d0f0f3a14 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032456 Jul 12 13:20:18.600246 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 18/35] 10.222.0.23 () {64 vars in 1332 bytes} [Tue Jul 12 13:20:18 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:20:38.190905 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-5753663f-ea19-48f0-a23b-b2e930de8ff5 admin admin] Calling method '>' {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:38.192188 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-5753663f-ea19-48f0-a23b-b2e930de8ff5 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Jul 12 13:20:38.192591 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 18/36] 10.222.0.23 () {54 vars in 930 bytes} [Tue Jul 12 13:20:38 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:20:38.203538 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG dbcounter [-] [103271] Writing DB stats nova_api:SELECT=5,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=103271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:20:38.583629 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-12cb4125-de44-4930-a50e-95bdfbc5ecba admin admin] Calling method '>' {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:38.600360 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-12cb4125-de44-4930-a50e-95bdfbc5ecba admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.401199 Jul 12 13:20:38.600889 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 19/37] 10.222.0.23 () {60 vars in 1291 bytes} [Tue Jul 12 13:20:38 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:20:39.675659 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-5753663f-ea19-48f0-a23b-b2e930de8ff5 admin admin] Calling method '>' {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:39.676666 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-5753663f-ea19-48f0-a23b-b2e930de8ff5 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 Jul 12 13:20:39.677068 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 19/38] 10.222.0.23 () {56 vars in 1074 bytes} [Tue Jul 12 13:20:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:20:40.209024 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-726bb2c2-a8f2-4b80-8417-00a0c36caf38 admin admin] Calling method '>' {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:40.215220 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.wsgi [None req-726bb2c2-a8f2-4b80-8417-00a0c36caf38 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 12 13:20:40.218522 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-726bb2c2-a8f2-4b80-8417-00a0c36caf38 admin admin] Request method failure captured: Jul 12 13:20:40.218522 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 12 13:20:40.218522 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: Accept: application/json Jul 12 13:20:40.218522 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: Accept-Encoding: gzip, deflate Jul 12 13:20:40.218522 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: Connection: keep-alive Jul 12 13:20:40.218522 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: Content-Length: 0 Jul 12 13:20:40.218522 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: Host: 10.222.0.23 Jul 12 13:20:40.218522 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: Openstack-Api-Version: compute 2.90 Jul 12 13:20:40.218522 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: Openstack-System-Scope: None Jul 12 13:20:40.218522 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: User-Agent: python-novaclient Jul 12 13:20:40.218522 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: X-Auth-Token: gAAAAABizXUnbUtWad2pLSAJadaEWbs0K6ktIAOceDGFiHuXEdeir9HZ4YCjjka75UlU853TBESxQ4D3BRx4W0hZbp15HQR_1E26qGjY2BKSMT0FPSRHZ7I8WzJqkoOwY-Dax0Q1WJrQKswM-l2pAesbG3gez4TiDqMLwWy46GcyZgMpMIPENsY Jul 12 13:20:40.218522 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: X-Domain-Id: None Jul 12 13:20:40.218522 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: X-Domain-Name: None Jul 12 13:20:40.218522 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: X-Identity-Status: Confirmed Jul 12 13:20:40.218522 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: X-Is-Admin-Project: True Jul 12 13:20:40.218522 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: X-Openstack-Nova-Api-Version: 2.90 Jul 12 13:20:40.218522 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: X-Project-Domain-Id: default Jul 12 13:20:40.218522 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: X-Project-Domain-Name: Default Jul 12 13:20:40.218522 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: X-Project-Id: 65457e2fc15c4d94825d2ac5ee397f82 Jul 12 13:20:40.218522 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: X-Project-Name: admin Jul 12 13:20:40.218522 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: X-Role: reader,member,admin Jul 12 13:20:40.218522 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: X-Roles: reader,member,admin Jul 12 13:20:40.220125 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/65457e2fc15c4d94825d2ac5ee397f82"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_65457e2fc15c4d94825d2ac5ee397f82", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/65457e2fc15c4d94825d2ac5ee397f82"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/65457e2fc15c4d94825d2ac5ee397f82"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] Jul 12 13:20:40.220125 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: X-Tenant: admin Jul 12 13:20:40.220125 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: X-Tenant-Id: 65457e2fc15c4d94825d2ac5ee397f82 Jul 12 13:20:40.220125 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: X-Tenant-Name: admin Jul 12 13:20:40.220125 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: X-User: admin Jul 12 13:20:40.220125 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: X-User-Domain-Id: default Jul 12 13:20:40.220125 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: X-User-Domain-Name: Default Jul 12 13:20:40.220125 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: X-User-Id: 417a441bd00d4df89cd837724e786c1e Jul 12 13:20:40.220125 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: X-User-Name: admin Jul 12 13:20:40.220125 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: method: > Jul 12 13:20:40.220125 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: exception: Flavor 42 could not be found. Jul 12 13:20:40.220125 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: action_args: {'id': '42'} Jul 12 13:20:40.220125 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 13:20:40.220125 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:20:40.221295 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 12 13:20:40.221295 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 12 13:20:40.221295 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 12 13:20:40.221295 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 12 13:20:40.221295 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 12 13:20:40.221295 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 12 13:20:40.221295 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 12 13:20:40.221295 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 12 13:20:40.221295 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 12 13:20:40.221295 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:20:40.221295 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 12 13:20:40.221295 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 12 13:20:40.221295 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 12 13:20:40.221295 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi Jul 12 13:20:40.221295 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:20:40.221295 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi Jul 12 13:20:40.221295 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:20:40.221295 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:20:40.221295 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:20:40.222748 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 13:20:40.222748 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 13:20:40.222748 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 13:20:40.222748 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:20:40.222748 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 12 13:20:40.222748 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 12 13:20:40.222748 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 12 13:20:40.222748 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi Jul 12 13:20:40.222748 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:20:40.222748 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi Jul 12 13:20:40.222748 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:20:40.222748 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:20:40.222748 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:20:40.222748 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 13:20:40.222748 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 13:20:40.222748 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 12 13:20:40.222748 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi Jul 12 13:20:40.222748 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-726bb2c2-a8f2-4b80-8417-00a0c36caf38 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103271) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 13:20:40.224039 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-726bb2c2-a8f2-4b80-8417-00a0c36caf38 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.400553 Jul 12 13:20:40.224039 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 20/39] 10.222.0.23 () {60 vars in 1190 bytes} [Tue Jul 12 13:20:39 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 402 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 12 13:20:40.230945 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-446bc137-01b8-4191-8691-3caf15ac81e4 admin admin] Calling method '>' {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:40.233911 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG dbcounter [-] [103272] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:20:40.253865 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-446bc137-01b8-4191-8691-3caf15ac81e4 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027349 Jul 12 13:20:40.254447 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 20/40] 10.222.0.23 () {60 vars in 1210 bytes} [Tue Jul 12 13:20:40 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 13:20:40.264103 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-149cce74-9d55-469b-9912-a53e3a03d74c admin admin] Calling method '>' {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:40.285752 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-149cce74-9d55-469b-9912-a53e3a03d74c admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025184 Jul 12 13:20:40.286297 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 21/41] 10.222.0.23 () {60 vars in 1210 bytes} [Tue Jul 12 13:20:40 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:20:40.295983 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-54bac9fd-6368-489c-914b-ccd358db951c admin admin] Calling method '>' {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:40.302122 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.wsgi [None req-54bac9fd-6368-489c-914b-ccd358db951c admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 12 13:20:40.305351 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-54bac9fd-6368-489c-914b-ccd358db951c admin admin] Request method failure captured: Jul 12 13:20:40.305351 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 12 13:20:40.305351 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: Accept: application/json Jul 12 13:20:40.305351 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: Accept-Encoding: gzip, deflate Jul 12 13:20:40.305351 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: Connection: keep-alive Jul 12 13:20:40.305351 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: Content-Length: 0 Jul 12 13:20:40.305351 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: Host: 10.222.0.23 Jul 12 13:20:40.305351 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: Openstack-Api-Version: compute 2.90 Jul 12 13:20:40.305351 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: Openstack-System-Scope: None Jul 12 13:20:40.305351 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: User-Agent: python-novaclient Jul 12 13:20:40.305351 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: X-Auth-Token: gAAAAABizXUnbUtWad2pLSAJadaEWbs0K6ktIAOceDGFiHuXEdeir9HZ4YCjjka75UlU853TBESxQ4D3BRx4W0hZbp15HQR_1E26qGjY2BKSMT0FPSRHZ7I8WzJqkoOwY-Dax0Q1WJrQKswM-l2pAesbG3gez4TiDqMLwWy46GcyZgMpMIPENsY Jul 12 13:20:40.305351 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: X-Domain-Id: None Jul 12 13:20:40.305351 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: X-Domain-Name: None Jul 12 13:20:40.305351 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: X-Identity-Status: Confirmed Jul 12 13:20:40.305351 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: X-Is-Admin-Project: True Jul 12 13:20:40.305351 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: X-Openstack-Nova-Api-Version: 2.90 Jul 12 13:20:40.305351 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: X-Project-Domain-Id: default Jul 12 13:20:40.305351 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: X-Project-Domain-Name: Default Jul 12 13:20:40.305351 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: X-Project-Id: 65457e2fc15c4d94825d2ac5ee397f82 Jul 12 13:20:40.305351 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: X-Project-Name: admin Jul 12 13:20:40.305351 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: X-Role: reader,member,admin Jul 12 13:20:40.305351 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: X-Roles: reader,member,admin Jul 12 13:20:40.307500 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/65457e2fc15c4d94825d2ac5ee397f82"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_65457e2fc15c4d94825d2ac5ee397f82", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/65457e2fc15c4d94825d2ac5ee397f82"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/65457e2fc15c4d94825d2ac5ee397f82"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] Jul 12 13:20:40.307500 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: X-Tenant: admin Jul 12 13:20:40.307500 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: X-Tenant-Id: 65457e2fc15c4d94825d2ac5ee397f82 Jul 12 13:20:40.307500 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: X-Tenant-Name: admin Jul 12 13:20:40.307500 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: X-User: admin Jul 12 13:20:40.307500 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: X-User-Domain-Id: default Jul 12 13:20:40.307500 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: X-User-Domain-Name: Default Jul 12 13:20:40.307500 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: X-User-Id: 417a441bd00d4df89cd837724e786c1e Jul 12 13:20:40.307500 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: X-User-Name: admin Jul 12 13:20:40.307500 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: method: > Jul 12 13:20:40.307500 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: exception: Flavor 42 could not be found. Jul 12 13:20:40.307500 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: action_args: {'id': '42'} Jul 12 13:20:40.307500 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 13:20:40.307500 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:20:40.308406 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 12 13:20:40.308406 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 12 13:20:40.308406 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 12 13:20:40.308406 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 12 13:20:40.308406 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 12 13:20:40.308406 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 12 13:20:40.308406 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 12 13:20:40.308406 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 12 13:20:40.308406 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 12 13:20:40.308406 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:20:40.308406 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 12 13:20:40.308406 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 12 13:20:40.308406 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 12 13:20:40.308406 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi Jul 12 13:20:40.308406 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:20:40.308406 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi Jul 12 13:20:40.308406 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:20:40.308406 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:20:40.308406 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:20:40.309706 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 13:20:40.309706 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 13:20:40.309706 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 13:20:40.309706 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:20:40.309706 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 12 13:20:40.309706 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 12 13:20:40.309706 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 12 13:20:40.309706 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi Jul 12 13:20:40.309706 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:20:40.309706 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi Jul 12 13:20:40.309706 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:20:40.309706 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:20:40.309706 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:20:40.309706 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 13:20:40.309706 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 13:20:40.309706 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 12 13:20:40.309706 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi Jul 12 13:20:40.309706 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-54bac9fd-6368-489c-914b-ccd358db951c admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103272) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 13:20:40.310904 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-54bac9fd-6368-489c-914b-ccd358db951c admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014877 Jul 12 13:20:40.310904 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 21/42] 10.222.0.23 () {60 vars in 1190 bytes} [Tue Jul 12 13:20:40 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 12 13:20:41.271045 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-149cce74-9d55-469b-9912-a53e3a03d74c admin admin] Calling method '>' {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:41.272047 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-149cce74-9d55-469b-9912-a53e3a03d74c admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 Jul 12 13:20:41.272445 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 22/43] 10.222.0.23 () {56 vars in 1074 bytes} [Tue Jul 12 13:20:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:20:41.803076 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-50590429-0cc7-4940-8c98-85e14ff92cf9 admin admin] Calling method '>' {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:41.808993 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.wsgi [None req-50590429-0cc7-4940-8c98-85e14ff92cf9 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 12 13:20:41.810559 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-50590429-0cc7-4940-8c98-85e14ff92cf9 admin admin] Request method failure captured: Jul 12 13:20:41.810559 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 12 13:20:41.810559 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: Accept: application/json Jul 12 13:20:41.810559 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: Accept-Encoding: gzip, deflate Jul 12 13:20:41.810559 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: Connection: keep-alive Jul 12 13:20:41.810559 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: Content-Length: 0 Jul 12 13:20:41.810559 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: Host: 10.222.0.23 Jul 12 13:20:41.810559 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: Openstack-Api-Version: compute 2.90 Jul 12 13:20:41.810559 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: Openstack-System-Scope: None Jul 12 13:20:41.810559 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: User-Agent: python-novaclient Jul 12 13:20:41.810559 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: X-Auth-Token: gAAAAABizXUpobhxTBoL_PaSmhCqk8aEUVLeQjVFSC7ykLRXdLe9LHGBgCVHwCHaLGIcnCfnZrOUE2JsBxAJwKF8etNl0S8QNjFRCVKKJrMeH6h0lRfYQGfi3Okk0laUam8iHm9xaWpqmZgm7jbfGuJiwQySucTVA3QLQn2QeBBmTKhu3VdmLME Jul 12 13:20:41.810559 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: X-Domain-Id: None Jul 12 13:20:41.810559 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: X-Domain-Name: None Jul 12 13:20:41.810559 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: X-Identity-Status: Confirmed Jul 12 13:20:41.810559 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: X-Is-Admin-Project: True Jul 12 13:20:41.810559 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: X-Openstack-Nova-Api-Version: 2.90 Jul 12 13:20:41.810559 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: X-Project-Domain-Id: default Jul 12 13:20:41.810559 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: X-Project-Domain-Name: Default Jul 12 13:20:41.810559 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: X-Project-Id: 65457e2fc15c4d94825d2ac5ee397f82 Jul 12 13:20:41.810559 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: X-Project-Name: admin Jul 12 13:20:41.810559 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: X-Role: reader,member,admin Jul 12 13:20:41.810559 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: X-Roles: reader,member,admin Jul 12 13:20:41.812096 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/65457e2fc15c4d94825d2ac5ee397f82"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_65457e2fc15c4d94825d2ac5ee397f82", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/65457e2fc15c4d94825d2ac5ee397f82"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/65457e2fc15c4d94825d2ac5ee397f82"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] Jul 12 13:20:41.812096 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: X-Tenant: admin Jul 12 13:20:41.812096 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: X-Tenant-Id: 65457e2fc15c4d94825d2ac5ee397f82 Jul 12 13:20:41.812096 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: X-Tenant-Name: admin Jul 12 13:20:41.812096 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: X-User: admin Jul 12 13:20:41.812096 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: X-User-Domain-Id: default Jul 12 13:20:41.812096 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: X-User-Domain-Name: Default Jul 12 13:20:41.812096 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: X-User-Id: 417a441bd00d4df89cd837724e786c1e Jul 12 13:20:41.812096 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: X-User-Name: admin Jul 12 13:20:41.812096 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: method: > Jul 12 13:20:41.812096 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: exception: Flavor 84 could not be found. Jul 12 13:20:41.812096 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: action_args: {'id': '84'} Jul 12 13:20:41.812096 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 13:20:41.812096 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:20:41.813062 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 12 13:20:41.813062 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 12 13:20:41.813062 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 12 13:20:41.813062 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 12 13:20:41.813062 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 12 13:20:41.813062 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 12 13:20:41.813062 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 12 13:20:41.813062 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 12 13:20:41.813062 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 12 13:20:41.813062 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:20:41.813062 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 12 13:20:41.813062 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 12 13:20:41.813062 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 12 13:20:41.813062 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi Jul 12 13:20:41.813062 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:20:41.813062 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi Jul 12 13:20:41.813062 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:20:41.813062 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:20:41.813062 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:20:41.814163 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 13:20:41.814163 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 13:20:41.814163 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 13:20:41.814163 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:20:41.814163 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 12 13:20:41.814163 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 12 13:20:41.814163 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 12 13:20:41.814163 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi Jul 12 13:20:41.814163 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:20:41.814163 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi Jul 12 13:20:41.814163 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:20:41.814163 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:20:41.814163 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:20:41.814163 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 13:20:41.814163 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 13:20:41.814163 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 12 13:20:41.814163 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi Jul 12 13:20:41.814163 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-50590429-0cc7-4940-8c98-85e14ff92cf9 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103272) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 13:20:41.815175 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-50590429-0cc7-4940-8c98-85e14ff92cf9 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.392762 Jul 12 13:20:41.815175 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 22/44] 10.222.0.23 () {60 vars in 1190 bytes} [Tue Jul 12 13:20:41 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 394 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 12 13:20:41.822062 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-75b7d99c-8629-49e7-9064-7419b188becd admin admin] Calling method '>' {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:41.835585 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-75b7d99c-8629-49e7-9064-7419b188becd admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017171 Jul 12 13:20:41.836109 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 23/45] 10.222.0.23 () {60 vars in 1210 bytes} [Tue Jul 12 13:20:41 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:20:41.845967 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-7a3508e2-56e1-41ae-9ec2-1a4f7540dd75 admin admin] Calling method '>' {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:41.860607 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-7a3508e2-56e1-41ae-9ec2-1a4f7540dd75 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018073 Jul 12 13:20:41.861143 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 23/46] 10.222.0.23 () {60 vars in 1210 bytes} [Tue Jul 12 13:20:41 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:20:41.870450 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-7840a975-203f-44d9-8781-9d3279da543c admin admin] Calling method '>' {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:41.876673 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.wsgi [None req-7840a975-203f-44d9-8781-9d3279da543c admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 12 13:20:41.878301 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-7840a975-203f-44d9-8781-9d3279da543c admin admin] Request method failure captured: Jul 12 13:20:41.878301 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 12 13:20:41.878301 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: Accept: application/json Jul 12 13:20:41.878301 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: Accept-Encoding: gzip, deflate Jul 12 13:20:41.878301 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: Connection: keep-alive Jul 12 13:20:41.878301 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: Content-Length: 0 Jul 12 13:20:41.878301 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: Host: 10.222.0.23 Jul 12 13:20:41.878301 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: Openstack-Api-Version: compute 2.90 Jul 12 13:20:41.878301 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: Openstack-System-Scope: None Jul 12 13:20:41.878301 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: User-Agent: python-novaclient Jul 12 13:20:41.878301 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: X-Auth-Token: gAAAAABizXUpobhxTBoL_PaSmhCqk8aEUVLeQjVFSC7ykLRXdLe9LHGBgCVHwCHaLGIcnCfnZrOUE2JsBxAJwKF8etNl0S8QNjFRCVKKJrMeH6h0lRfYQGfi3Okk0laUam8iHm9xaWpqmZgm7jbfGuJiwQySucTVA3QLQn2QeBBmTKhu3VdmLME Jul 12 13:20:41.878301 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: X-Domain-Id: None Jul 12 13:20:41.878301 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: X-Domain-Name: None Jul 12 13:20:41.878301 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: X-Identity-Status: Confirmed Jul 12 13:20:41.878301 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: X-Is-Admin-Project: True Jul 12 13:20:41.878301 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: X-Openstack-Nova-Api-Version: 2.90 Jul 12 13:20:41.878301 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: X-Project-Domain-Id: default Jul 12 13:20:41.878301 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: X-Project-Domain-Name: Default Jul 12 13:20:41.878301 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: X-Project-Id: 65457e2fc15c4d94825d2ac5ee397f82 Jul 12 13:20:41.878301 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: X-Project-Name: admin Jul 12 13:20:41.878301 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: X-Role: reader,member,admin Jul 12 13:20:41.878301 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: X-Roles: reader,member,admin Jul 12 13:20:41.879819 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/65457e2fc15c4d94825d2ac5ee397f82"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_65457e2fc15c4d94825d2ac5ee397f82", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/65457e2fc15c4d94825d2ac5ee397f82"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/65457e2fc15c4d94825d2ac5ee397f82"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] Jul 12 13:20:41.879819 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: X-Tenant: admin Jul 12 13:20:41.879819 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: X-Tenant-Id: 65457e2fc15c4d94825d2ac5ee397f82 Jul 12 13:20:41.879819 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: X-Tenant-Name: admin Jul 12 13:20:41.879819 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: X-User: admin Jul 12 13:20:41.879819 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: X-User-Domain-Id: default Jul 12 13:20:41.879819 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: X-User-Domain-Name: Default Jul 12 13:20:41.879819 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: X-User-Id: 417a441bd00d4df89cd837724e786c1e Jul 12 13:20:41.879819 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: X-User-Name: admin Jul 12 13:20:41.879819 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: method: > Jul 12 13:20:41.879819 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: exception: Flavor 84 could not be found. Jul 12 13:20:41.879819 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: action_args: {'id': '84'} Jul 12 13:20:41.879819 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 13:20:41.879819 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:20:41.880669 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 12 13:20:41.880669 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 12 13:20:41.880669 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 12 13:20:41.880669 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 12 13:20:41.880669 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 12 13:20:41.880669 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 12 13:20:41.880669 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 12 13:20:41.880669 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 12 13:20:41.880669 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 12 13:20:41.880669 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:20:41.880669 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 12 13:20:41.880669 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 12 13:20:41.880669 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 12 13:20:41.880669 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi Jul 12 13:20:41.880669 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:20:41.880669 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi Jul 12 13:20:41.880669 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:20:41.880669 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:20:41.880669 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:20:41.881757 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 13:20:41.881757 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 13:20:41.881757 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 13:20:41.881757 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:20:41.881757 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 12 13:20:41.881757 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 12 13:20:41.881757 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 12 13:20:41.881757 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi Jul 12 13:20:41.881757 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:20:41.881757 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi Jul 12 13:20:41.881757 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:20:41.881757 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:20:41.881757 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:20:41.881757 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 13:20:41.881757 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 13:20:41.881757 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 12 13:20:41.881757 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi Jul 12 13:20:41.881757 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-7840a975-203f-44d9-8781-9d3279da543c admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103271) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 13:20:41.882727 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-7840a975-203f-44d9-8781-9d3279da543c admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012968 Jul 12 13:20:41.882727 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 24/47] 10.222.0.23 () {60 vars in 1190 bytes} [Tue Jul 12 13:20:41 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 12 13:20:42.855353 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-7a3508e2-56e1-41ae-9ec2-1a4f7540dd75 admin admin] Calling method '>' {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:42.856341 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-7a3508e2-56e1-41ae-9ec2-1a4f7540dd75 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001423 Jul 12 13:20:42.856744 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 24/48] 10.222.0.23 () {56 vars in 1074 bytes} [Tue Jul 12 13:20:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:20:43.387374 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-caa35ccb-554e-4799-ae1a-bcf718df97ae admin admin] Calling method '>' {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:43.393078 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.wsgi [None req-caa35ccb-554e-4799-ae1a-bcf718df97ae admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 12 13:20:43.394613 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-caa35ccb-554e-4799-ae1a-bcf718df97ae admin admin] Request method failure captured: Jul 12 13:20:43.394613 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 12 13:20:43.394613 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: Accept: application/json Jul 12 13:20:43.394613 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: Accept-Encoding: gzip, deflate Jul 12 13:20:43.394613 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: Connection: keep-alive Jul 12 13:20:43.394613 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: Content-Length: 0 Jul 12 13:20:43.394613 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: Host: 10.222.0.23 Jul 12 13:20:43.394613 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: Openstack-Api-Version: compute 2.90 Jul 12 13:20:43.394613 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: Openstack-System-Scope: None Jul 12 13:20:43.394613 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: User-Agent: python-novaclient Jul 12 13:20:43.394613 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: X-Auth-Token: gAAAAABizXUqdQ5E2qNZEL1QqggHDl4HrdPw5Ju2H-ewET2zHGWiqjsMyMhTELAAc5tG8AhaPGRVxvw19M-B_pqo5vjeTu0k_rDSll4GE-n_Mp80KXU5mgHF897S6QVKYVM4TlyO8U8MdrNiwuFb7J5PR7VqQtzJOa0YURLlWt-I7v1Zf2ZthjM Jul 12 13:20:43.394613 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: X-Domain-Id: None Jul 12 13:20:43.394613 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: X-Domain-Name: None Jul 12 13:20:43.394613 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: X-Identity-Status: Confirmed Jul 12 13:20:43.394613 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: X-Is-Admin-Project: True Jul 12 13:20:43.394613 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: X-Openstack-Nova-Api-Version: 2.90 Jul 12 13:20:43.394613 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: X-Project-Domain-Id: default Jul 12 13:20:43.394613 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: X-Project-Domain-Name: Default Jul 12 13:20:43.394613 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: X-Project-Id: 65457e2fc15c4d94825d2ac5ee397f82 Jul 12 13:20:43.394613 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: X-Project-Name: admin Jul 12 13:20:43.394613 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: X-Role: reader,member,admin Jul 12 13:20:43.394613 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: X-Roles: reader,member,admin Jul 12 13:20:43.396096 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/65457e2fc15c4d94825d2ac5ee397f82"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_65457e2fc15c4d94825d2ac5ee397f82", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/65457e2fc15c4d94825d2ac5ee397f82"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/65457e2fc15c4d94825d2ac5ee397f82"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] Jul 12 13:20:43.396096 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: X-Tenant: admin Jul 12 13:20:43.396096 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: X-Tenant-Id: 65457e2fc15c4d94825d2ac5ee397f82 Jul 12 13:20:43.396096 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: X-Tenant-Name: admin Jul 12 13:20:43.396096 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: X-User: admin Jul 12 13:20:43.396096 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: X-User-Domain-Id: default Jul 12 13:20:43.396096 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: X-User-Domain-Name: Default Jul 12 13:20:43.396096 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: X-User-Id: 417a441bd00d4df89cd837724e786c1e Jul 12 13:20:43.396096 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: X-User-Name: admin Jul 12 13:20:43.396096 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: method: > Jul 12 13:20:43.396096 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: exception: Flavor 451 could not be found. Jul 12 13:20:43.396096 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: action_args: {'id': '451'} Jul 12 13:20:43.396096 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 13:20:43.396096 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:20:43.397124 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 12 13:20:43.397124 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 12 13:20:43.397124 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 12 13:20:43.397124 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 12 13:20:43.397124 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 12 13:20:43.397124 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 12 13:20:43.397124 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 12 13:20:43.397124 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 12 13:20:43.397124 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 12 13:20:43.397124 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:20:43.397124 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 12 13:20:43.397124 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 12 13:20:43.397124 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 12 13:20:43.397124 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi Jul 12 13:20:43.397124 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:20:43.397124 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi Jul 12 13:20:43.397124 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:20:43.397124 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:20:43.397124 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:20:43.398505 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 13:20:43.398505 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 13:20:43.398505 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 13:20:43.398505 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:20:43.398505 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 12 13:20:43.398505 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 12 13:20:43.398505 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 12 13:20:43.398505 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi Jul 12 13:20:43.398505 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:20:43.398505 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi Jul 12 13:20:43.398505 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:20:43.398505 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:20:43.398505 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:20:43.398505 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 13:20:43.398505 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 13:20:43.398505 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 12 13:20:43.398505 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi Jul 12 13:20:43.398505 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-caa35ccb-554e-4799-ae1a-bcf718df97ae admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103271) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 13:20:43.400682 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-caa35ccb-554e-4799-ae1a-bcf718df97ae admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.401317 Jul 12 13:20:43.400682 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 25/49] 10.222.0.23 () {60 vars in 1193 bytes} [Tue Jul 12 13:20:42 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 402 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 12 13:20:43.405740 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-1b34278a-5e97-4154-b05d-b63948eb455e admin admin] Calling method '>' {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:43.419547 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-1b34278a-5e97-4154-b05d-b63948eb455e admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017327 Jul 12 13:20:43.420066 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 25/50] 10.222.0.23 () {60 vars in 1210 bytes} [Tue Jul 12 13:20:43 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:20:43.429188 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-5f47e966-4dd9-4bdd-9c60-8ef6489025a0 admin admin] Calling method '>' {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:43.444927 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-5f47e966-4dd9-4bdd-9c60-8ef6489025a0 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019010 Jul 12 13:20:43.445477 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 26/51] 10.222.0.23 () {60 vars in 1210 bytes} [Tue Jul 12 13:20:43 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 13:20:43.455269 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-068fe770-78ed-4098-ad9e-9e6247f9ad9a admin admin] Calling method '>' {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:43.460543 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.wsgi [None req-068fe770-78ed-4098-ad9e-9e6247f9ad9a admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 12 13:20:43.462076 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-068fe770-78ed-4098-ad9e-9e6247f9ad9a admin admin] Request method failure captured: Jul 12 13:20:43.462076 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 12 13:20:43.462076 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: Accept: application/json Jul 12 13:20:43.462076 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: Accept-Encoding: gzip, deflate Jul 12 13:20:43.462076 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: Connection: keep-alive Jul 12 13:20:43.462076 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: Content-Length: 0 Jul 12 13:20:43.462076 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: Host: 10.222.0.23 Jul 12 13:20:43.462076 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: Openstack-Api-Version: compute 2.90 Jul 12 13:20:43.462076 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: Openstack-System-Scope: None Jul 12 13:20:43.462076 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: User-Agent: python-novaclient Jul 12 13:20:43.462076 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: X-Auth-Token: gAAAAABizXUqdQ5E2qNZEL1QqggHDl4HrdPw5Ju2H-ewET2zHGWiqjsMyMhTELAAc5tG8AhaPGRVxvw19M-B_pqo5vjeTu0k_rDSll4GE-n_Mp80KXU5mgHF897S6QVKYVM4TlyO8U8MdrNiwuFb7J5PR7VqQtzJOa0YURLlWt-I7v1Zf2ZthjM Jul 12 13:20:43.462076 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: X-Domain-Id: None Jul 12 13:20:43.462076 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: X-Domain-Name: None Jul 12 13:20:43.462076 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: X-Identity-Status: Confirmed Jul 12 13:20:43.462076 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: X-Is-Admin-Project: True Jul 12 13:20:43.462076 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: X-Openstack-Nova-Api-Version: 2.90 Jul 12 13:20:43.462076 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: X-Project-Domain-Id: default Jul 12 13:20:43.462076 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: X-Project-Domain-Name: Default Jul 12 13:20:43.462076 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: X-Project-Id: 65457e2fc15c4d94825d2ac5ee397f82 Jul 12 13:20:43.462076 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: X-Project-Name: admin Jul 12 13:20:43.462076 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: X-Role: reader,member,admin Jul 12 13:20:43.462076 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: X-Roles: reader,member,admin Jul 12 13:20:43.463827 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/65457e2fc15c4d94825d2ac5ee397f82"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_65457e2fc15c4d94825d2ac5ee397f82", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/65457e2fc15c4d94825d2ac5ee397f82"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/65457e2fc15c4d94825d2ac5ee397f82"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] Jul 12 13:20:43.463827 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: X-Tenant: admin Jul 12 13:20:43.463827 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: X-Tenant-Id: 65457e2fc15c4d94825d2ac5ee397f82 Jul 12 13:20:43.463827 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: X-Tenant-Name: admin Jul 12 13:20:43.463827 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: X-User: admin Jul 12 13:20:43.463827 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: X-User-Domain-Id: default Jul 12 13:20:43.463827 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: X-User-Domain-Name: Default Jul 12 13:20:43.463827 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: X-User-Id: 417a441bd00d4df89cd837724e786c1e Jul 12 13:20:43.463827 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: X-User-Name: admin Jul 12 13:20:43.463827 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: method: > Jul 12 13:20:43.463827 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: exception: Flavor 451 could not be found. Jul 12 13:20:43.463827 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: action_args: {'id': '451'} Jul 12 13:20:43.463827 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 13:20:43.463827 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:20:43.464691 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 12 13:20:43.464691 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 12 13:20:43.464691 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 12 13:20:43.464691 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 12 13:20:43.464691 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 12 13:20:43.464691 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 12 13:20:43.464691 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 12 13:20:43.464691 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 12 13:20:43.464691 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 12 13:20:43.464691 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:20:43.464691 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 12 13:20:43.464691 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 12 13:20:43.464691 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 12 13:20:43.464691 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi Jul 12 13:20:43.464691 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:20:43.464691 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi Jul 12 13:20:43.464691 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:20:43.464691 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:20:43.464691 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:20:43.465868 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 13:20:43.465868 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 13:20:43.465868 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 13:20:43.465868 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:20:43.465868 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 12 13:20:43.465868 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 12 13:20:43.465868 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 12 13:20:43.465868 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi Jul 12 13:20:43.465868 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:20:43.465868 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi Jul 12 13:20:43.465868 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:20:43.465868 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:20:43.465868 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:20:43.465868 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 13:20:43.465868 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 13:20:43.465868 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 12 13:20:43.465868 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi Jul 12 13:20:43.465868 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-068fe770-78ed-4098-ad9e-9e6247f9ad9a admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103272) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 13:20:43.466857 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-068fe770-78ed-4098-ad9e-9e6247f9ad9a admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011822 Jul 12 13:20:43.466857 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 26/52] 10.222.0.23 () {60 vars in 1193 bytes} [Tue Jul 12 13:20:43 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 12 13:20:44.427019 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-5f47e966-4dd9-4bdd-9c60-8ef6489025a0 admin admin] Calling method '>' {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:44.428048 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-5f47e966-4dd9-4bdd-9c60-8ef6489025a0 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001428 Jul 12 13:20:44.428470 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 27/53] 10.222.0.23 () {56 vars in 1074 bytes} [Tue Jul 12 13:20:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:20:44.952088 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-8640aa14-8359-4c9e-a660-48d4cd1ef4ae admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:20:44.970479 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-8640aa14-8359-4c9e-a660-48d4cd1ef4ae admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.403321 Jul 12 13:20:44.971009 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 27/54] 10.222.0.23 () {64 vars in 1235 bytes} [Tue Jul 12 13:20:44 2022] POST /compute/v2.1/flavors => generated 404 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 13:20:45.935993 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-5f47e966-4dd9-4bdd-9c60-8ef6489025a0 admin admin] Calling method '>' {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:45.936992 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-5f47e966-4dd9-4bdd-9c60-8ef6489025a0 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001416 Jul 12 13:20:45.937419 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 28/55] 10.222.0.23 () {56 vars in 1074 bytes} [Tue Jul 12 13:20:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:20:46.465714 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-bdc10bf2-ed85-4d12-a7ce-5400be09484a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:20:46.482366 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-bdc10bf2-ed85-4d12-a7ce-5400be09484a admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.404048 Jul 12 13:20:46.482935 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 28/56] 10.222.0.23 () {64 vars in 1235 bytes} [Tue Jul 12 13:20:46 2022] POST /compute/v2.1/flavors => generated 405 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 13:20:47.450204 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-5f47e966-4dd9-4bdd-9c60-8ef6489025a0 admin admin] Calling method '>' {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:47.451208 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-5f47e966-4dd9-4bdd-9c60-8ef6489025a0 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Jul 12 13:20:47.451610 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 29/57] 10.222.0.23 () {56 vars in 1074 bytes} [Tue Jul 12 13:20:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:20:47.969751 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-7bb97797-5710-49ff-8ff7-09038d1c96b4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:20:47.986452 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-7bb97797-5710-49ff-8ff7-09038d1c96b4 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.397212 Jul 12 13:20:47.986996 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 29/58] 10.222.0.23 () {64 vars in 1235 bytes} [Tue Jul 12 13:20:47 2022] POST /compute/v2.1/flavors => generated 407 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 13:20:48.963052 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-5f47e966-4dd9-4bdd-9c60-8ef6489025a0 admin admin] Calling method '>' {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:48.964007 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-5f47e966-4dd9-4bdd-9c60-8ef6489025a0 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002039 Jul 12 13:20:48.964398 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 30/59] 10.222.0.23 () {56 vars in 1074 bytes} [Tue Jul 12 13:20:48 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:20:49.487851 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-4848e546-f069-4b9e-a197-43f1b54eb7b3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:20:49.506065 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-4848e546-f069-4b9e-a197-43f1b54eb7b3 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.404020 Jul 12 13:20:49.506546 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 30/60] 10.222.0.23 () {64 vars in 1235 bytes} [Tue Jul 12 13:20:49 2022] POST /compute/v2.1/flavors => generated 409 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 12 13:20:50.474072 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-5f47e966-4dd9-4bdd-9c60-8ef6489025a0 admin admin] Calling method '>' {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:50.475084 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-5f47e966-4dd9-4bdd-9c60-8ef6489025a0 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 Jul 12 13:20:50.475476 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 31/61] 10.222.0.23 () {56 vars in 1074 bytes} [Tue Jul 12 13:20:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:20:50.992159 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-35b74643-c959-4d23-8f56-5a1144780a33 admin admin] Calling method '>' {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:51.011625 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-35b74643-c959-4d23-8f56-5a1144780a33 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.398943 Jul 12 13:20:51.012171 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 31/62] 10.222.0.23 () {60 vars in 1202 bytes} [Tue Jul 12 13:20:50 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:21:42.611188 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-5f47e966-4dd9-4bdd-9c60-8ef6489025a0 admin admin] Calling method '>' {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:21:42.612196 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-5f47e966-4dd9-4bdd-9c60-8ef6489025a0 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Jul 12 13:21:42.612590 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 32/63] 10.222.0.23 () {54 vars in 930 bytes} [Tue Jul 12 13:21:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:21:42.623899 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG dbcounter [-] [103272] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:21:43.003076 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-e1e9bcbc-0370-44e3-848b-a95d76d495b4 admin admin] Calling method '>' {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:21:43.022624 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-e1e9bcbc-0370-44e3-848b-a95d76d495b4 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.403191 Jul 12 13:21:43.023166 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 32/64] 10.222.0.23 () {60 vars in 1291 bytes} [Tue Jul 12 13:21:42 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:21:43.046439 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-b560086f-c54c-45f0-94ab-d1a7c5e254eb admin admin] Calling method '>' {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:21:43.049858 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG dbcounter [-] [103271] Writing DB stats nova_api:SELECT=14 {{(pid=103271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:21:43.055555 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-b560086f-c54c-45f0-94ab-d1a7c5e254eb admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012706 Jul 12 13:21:43.056115 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 33/65] 10.222.0.23 () {60 vars in 1282 bytes} [Tue Jul 12 13:21:43 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:21:43.067638 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-f45b19a8-5e39-45da-8565-0c12862d3873 admin admin] Calling method '>' {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:21:43.075103 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-f45b19a8-5e39-45da-8565-0c12862d3873 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011229 Jul 12 13:21:43.075609 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 33/66] 10.222.0.23 () {60 vars in 1285 bytes} [Tue Jul 12 13:21:43 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:21:43.087690 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-bc3a3d7d-6bd8-45fe-a207-4527710258bd admin admin] Calling method '>' {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:21:43.095192 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-bc3a3d7d-6bd8-45fe-a207-4527710258bd admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012091 Jul 12 13:21:43.095699 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 34/67] 10.222.0.23 () {60 vars in 1285 bytes} [Tue Jul 12 13:21:43 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:21:43.107317 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-50195b63-55ea-44d9-9fba-02443cd15a7a admin admin] Calling method '>' {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:21:43.114772 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-50195b63-55ea-44d9-9fba-02443cd15a7a admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011126 Jul 12 13:21:43.115506 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 34/68] 10.222.0.23 () {60 vars in 1282 bytes} [Tue Jul 12 13:21:43 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:25:08.518586 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-bc3a3d7d-6bd8-45fe-a207-4527710258bd admin admin] Calling method '>' {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:25:08.519615 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-bc3a3d7d-6bd8-45fe-a207-4527710258bd admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001518 Jul 12 13:25:08.520180 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 35/69] 10.222.0.23 () {56 vars in 1074 bytes} [Tue Jul 12 13:25:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:25:08.659239 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG dbcounter [-] [103272] Writing DB stats nova_api:SELECT=6 {{(pid=103272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:25:08.818223 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-e44fd40b-8374-4119-96d4-2f50032a8bb2 admin admin] Calling method '>' {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:25:08.819567 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 13:25:08.819567 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: warnings.warn(msg) Jul 12 13:25:08.820753 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG oslo_concurrency.lockutils [None req-e44fd40b-8374-4119-96d4-2f50032a8bb2 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:25:08.821185 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG oslo_concurrency.lockutils [None req-e44fd40b-8374-4119-96d4-2f50032a8bb2 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:25:08.822291 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG oslo_concurrency.lockutils [None req-e44fd40b-8374-4119-96d4-2f50032a8bb2 admin admin] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:25:08.822715 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG oslo_concurrency.lockutils [None req-e44fd40b-8374-4119-96d4-2f50032a8bb2 admin admin] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:25:08.857485 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-e44fd40b-8374-4119-96d4-2f50032a8bb2 admin admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.199660 Jul 12 13:25:08.858055 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 35/70] 10.222.0.23 () {60 vars in 1193 bytes} [Tue Jul 12 13:25:08 2022] GET /compute/v2.1/os-services => generated 794 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 13:25:09.679155 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-bc3a3d7d-6bd8-45fe-a207-4527710258bd admin admin] Calling method '>' {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:25:09.680191 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-bc3a3d7d-6bd8-45fe-a207-4527710258bd admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001424 Jul 12 13:25:09.680589 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 36/71] 10.222.0.23 () {56 vars in 1074 bytes} [Tue Jul 12 13:25:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:25:09.870054 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-806ff961-6660-4a20-a95d-d931beaa158d admin admin] Calling method '>' {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:25:09.871236 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 13:25:09.871236 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: warnings.warn(msg) Jul 12 13:25:09.872426 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG oslo_concurrency.lockutils [None req-806ff961-6660-4a20-a95d-d931beaa158d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:25:09.872859 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG oslo_concurrency.lockutils [None req-806ff961-6660-4a20-a95d-d931beaa158d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:25:09.873659 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG oslo_concurrency.lockutils [None req-806ff961-6660-4a20-a95d-d931beaa158d admin admin] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:25:09.874078 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG oslo_concurrency.lockutils [None req-806ff961-6660-4a20-a95d-d931beaa158d admin admin] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:25:09.893022 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-806ff961-6660-4a20-a95d-d931beaa158d admin admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.075099 Jul 12 13:25:09.893530 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 36/72] 10.222.0.23 () {60 vars in 1193 bytes} [Tue Jul 12 13:25:09 2022] GET /compute/v2.1/os-services => generated 794 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 12 13:25:21.146902 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-bc3a3d7d-6bd8-45fe-a207-4527710258bd admin admin] Calling method '>' {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:25:21.147942 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-bc3a3d7d-6bd8-45fe-a207-4527710258bd admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 Jul 12 13:25:21.148339 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 37/73] 10.222.0.23 () {56 vars in 1074 bytes} [Tue Jul 12 13:25:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:25:21.291597 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG dbcounter [-] [103272] Writing DB stats nova_cell0:SELECT=4 {{(pid=103272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:25:21.292321 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG dbcounter [-] [103272] Writing DB stats nova_cell1:SELECT=4 {{(pid=103272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:25:21.293005 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG dbcounter [-] [103272] Writing DB stats nova_api:SELECT=8 {{(pid=103272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:25:21.340782 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-1d012faf-b8c6-4f7f-9cfb-bdfe422db08a admin admin] Calling method '>' {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:25:21.341988 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 13:25:21.341988 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: warnings.warn(msg) Jul 12 13:25:21.343166 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG oslo_concurrency.lockutils [None req-1d012faf-b8c6-4f7f-9cfb-bdfe422db08a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:25:21.343610 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG oslo_concurrency.lockutils [None req-1d012faf-b8c6-4f7f-9cfb-bdfe422db08a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:25:21.344414 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG oslo_concurrency.lockutils [None req-1d012faf-b8c6-4f7f-9cfb-bdfe422db08a admin admin] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:25:21.344835 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG oslo_concurrency.lockutils [None req-1d012faf-b8c6-4f7f-9cfb-bdfe422db08a admin admin] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:25:21.371816 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-1d012faf-b8c6-4f7f-9cfb-bdfe422db08a admin admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.084810 Jul 12 13:25:21.372307 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 37/74] 10.222.0.23 () {60 vars in 1193 bytes} [Tue Jul 12 13:25:21 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:25:22.316991 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-bc3a3d7d-6bd8-45fe-a207-4527710258bd admin admin] Calling method '>' {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:25:22.318135 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-bc3a3d7d-6bd8-45fe-a207-4527710258bd admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001756 Jul 12 13:25:22.318615 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 38/75] 10.222.0.23 () {56 vars in 1074 bytes} [Tue Jul 12 13:25:22 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:25:22.510239 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-0895d3ed-e963-484f-9f65-f312fa50bd45 admin admin] Calling method '>' {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:25:22.511462 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 13:25:22.511462 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: warnings.warn(msg) Jul 12 13:25:22.512649 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG oslo_concurrency.lockutils [None req-0895d3ed-e963-484f-9f65-f312fa50bd45 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:25:22.513078 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG oslo_concurrency.lockutils [None req-0895d3ed-e963-484f-9f65-f312fa50bd45 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:25:22.513880 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG oslo_concurrency.lockutils [None req-0895d3ed-e963-484f-9f65-f312fa50bd45 admin admin] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:25:22.514300 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: DEBUG oslo_concurrency.lockutils [None req-0895d3ed-e963-484f-9f65-f312fa50bd45 admin admin] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:25:22.537027 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-0895d3ed-e963-484f-9f65-f312fa50bd45 admin admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.078948 Jul 12 13:25:22.537606 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 38/76] 10.222.0.23 () {60 vars in 1193 bytes} [Tue Jul 12 13:25:22 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:26:20.400157 dv-cinder-820027-10-iscsi devstack@n-api.service[103270]: Tue Jul 12 13:26:20 2022 - graceful shutdown triggered... Jul 12 13:26:20.400197 dv-cinder-820027-10-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jul 12 13:26:20.401100 dv-cinder-820027-10-iscsi devstack@n-api.service[103271]: Gracefully killing worker 1 (pid: 103271)... Jul 12 13:26:20.401980 dv-cinder-820027-10-iscsi devstack@n-api.service[103272]: Gracefully killing worker 2 (pid: 103272)... Jul 12 13:26:21.401236 dv-cinder-820027-10-iscsi devstack@n-api.service[103270]: worker 1 buried after 1 seconds Jul 12 13:26:21.401236 dv-cinder-820027-10-iscsi devstack@n-api.service[103270]: worker 2 buried after 1 seconds Jul 12 13:26:21.401236 dv-cinder-820027-10-iscsi devstack@n-api.service[103270]: goodbye to uWSGI. Jul 12 13:26:21.402875 dv-cinder-820027-10-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jul 12 13:26:21.403415 dv-cinder-820027-10-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jul 12 13:26:21.406214 dv-cinder-820027-10-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 12 13:26:21.416300 dv-cinder-820027-10-iscsi devstack@n-api.service[117974]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 12 13:26:21.420034 dv-cinder-820027-10-iscsi devstack@n-api.service[117974]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jul 12 13:26:21 2022] *** Jul 12 13:26:21.420255 dv-cinder-820027-10-iscsi devstack@n-api.service[117974]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 12 13:26:21.420372 dv-cinder-820027-10-iscsi devstack@n-api.service[117974]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 12 13:26:21.420465 dv-cinder-820027-10-iscsi devstack@n-api.service[117974]: nodename: dv-cinder-820027-10-iscsi Jul 12 13:26:21.420616 dv-cinder-820027-10-iscsi devstack@n-api.service[117974]: machine: x86_64 Jul 12 13:26:21.420743 dv-cinder-820027-10-iscsi devstack@n-api.service[117974]: clock source: unix Jul 12 13:26:21.420850 dv-cinder-820027-10-iscsi devstack@n-api.service[117974]: pcre jit disabled Jul 12 13:26:21.420949 dv-cinder-820027-10-iscsi devstack@n-api.service[117974]: detected number of CPU cores: 4 Jul 12 13:26:21.421037 dv-cinder-820027-10-iscsi devstack@n-api.service[117974]: current working directory: / Jul 12 13:26:21.421146 dv-cinder-820027-10-iscsi devstack@n-api.service[117974]: detected binary path: /usr/bin/uwsgi-core Jul 12 13:26:21.421271 dv-cinder-820027-10-iscsi devstack@n-api.service[117974]: your processes number limit is 47680 Jul 12 13:26:21.421271 dv-cinder-820027-10-iscsi devstack@n-api.service[117974]: your memory page size is 4096 bytes Jul 12 13:26:21.421271 dv-cinder-820027-10-iscsi devstack@n-api.service[117974]: detected max file descriptor number: 2048 Jul 12 13:26:21.421271 dv-cinder-820027-10-iscsi devstack@n-api.service[117974]: lock engine: pthread robust mutexes Jul 12 13:26:21.421645 dv-cinder-820027-10-iscsi devstack@n-api.service[117974]: thunder lock: enabled Jul 12 13:26:21.421875 dv-cinder-820027-10-iscsi devstack@n-api.service[117974]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 12 13:26:21.421875 dv-cinder-820027-10-iscsi devstack@n-api.service[117974]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 12 13:26:21.474719 dv-cinder-820027-10-iscsi devstack@n-api.service[117974]: Python main interpreter initialized at 0x557f457b99c0 Jul 12 13:26:21.474719 dv-cinder-820027-10-iscsi devstack@n-api.service[117974]: python threads support enabled Jul 12 13:26:21.474719 dv-cinder-820027-10-iscsi devstack@n-api.service[117974]: your server socket listen backlog is limited to 100 connections Jul 12 13:26:21.474719 dv-cinder-820027-10-iscsi devstack@n-api.service[117974]: your mercy for graceful operations on workers is 90 seconds Jul 12 13:26:21.475179 dv-cinder-820027-10-iscsi devstack@n-api.service[117974]: mapped 403077 bytes (393 KB) for 2 cores Jul 12 13:26:21.475179 dv-cinder-820027-10-iscsi devstack@n-api.service[117974]: *** Operational MODE: preforking *** Jul 12 13:26:21.475481 dv-cinder-820027-10-iscsi devstack@n-api.service[117974]: *** uWSGI is running in multiple interpreter mode *** Jul 12 13:26:21.475481 dv-cinder-820027-10-iscsi devstack@n-api.service[117974]: spawned uWSGI master process (pid: 117974) Jul 12 13:26:21.475691 dv-cinder-820027-10-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 12 13:26:21.476275 dv-cinder-820027-10-iscsi devstack@n-api.service[117974]: spawned uWSGI worker 1 (pid: 117987, cores: 1) Jul 12 13:26:21.476696 dv-cinder-820027-10-iscsi devstack@n-api.service[117974]: spawned uWSGI worker 2 (pid: 117988, cores: 1) Jul 12 13:26:21.477020 dv-cinder-820027-10-iscsi devstack@n-api.service[117974]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 12 13:26:22.216878 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 12 13:26:22.234788 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 12 13:26:23.460836 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 12 13:26:23.460836 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: from cryptography.utils import int_from_bytes Jul 12 13:26:23.461766 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 12 13:26:23.461766 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: from cryptography.utils import int_from_bytes Jul 12 13:26:23.559839 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 12 13:26:23.559839 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: from cryptography.utils import int_from_bytes Jul 12 13:26:23.560438 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 12 13:26:23.560438 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: from cryptography.utils import int_from_bytes Jul 12 13:26:25.793959 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 12 13:26:25.794643 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 12 13:26:25.795103 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 12 13:26:25.795630 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 12 13:26:25.795987 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 12 13:26:25.796535 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.796997 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.797475 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.797936 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.798463 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.798863 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.799331 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.799792 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.800266 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.801227 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.801722 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.802216 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-820027-10-iscsi {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.802598 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.802919 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.803235 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.803558 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.803860 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.804186 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.804496 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.805001 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.806993 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.807550 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.808093 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.808693 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.809237 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.809810 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.810354 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.810882 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.811297 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.811665 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.812367 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-820027-10-iscsi {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.812732 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.813065 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.813412 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.813871 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.814190 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.814507 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.814832 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.815176 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.815496 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.815827 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.816194 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.816615 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.817032 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.817345 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.817685 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.818002 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.818326 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.818638 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.818947 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.819199 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.819509 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.819833 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.820157 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.820480 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.820734 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.820984 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.821302 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.821648 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.821960 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.822269 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.822577 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.822885 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.823192 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.823499 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.823805 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.824112 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.824431 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.824747 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.825070 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.825405 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.825725 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.826130 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.23 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.826381 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.23 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.826694 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.827034 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.827350 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.827659 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.827977 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.828296 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.828603 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.828908 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.829214 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.829555 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.829890 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.830192 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.830442 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.830744 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.831048 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.831364 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.831872 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.832469 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.832903 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.833208 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.833543 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.833853 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.834706 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.834706 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.834865 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.835062 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.835339 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.835656 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.835954 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.836277 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.836597 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.836900 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.837212 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.837532 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.837839 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.838158 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.838463 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.838767 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.839086 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.839391 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.839693 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.840288 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.840288 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.840621 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.840906 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.841219 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.841570 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.841868 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.842178 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.846641 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.846641 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.846641 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.846641 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.846641 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.846641 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.846641 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.846641 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.851860 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.851860 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.851860 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.851860 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.851860 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.851860 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.851860 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.851860 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.852993 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.852993 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.852993 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.852993 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.852993 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.852993 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.852993 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.852993 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.854364 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.854364 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.854364 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.854364 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.854364 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.854364 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.854364 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.854364 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.855661 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.855661 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.855661 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.855661 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.855661 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.855661 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.855661 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.855661 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.856781 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.856781 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.856781 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.856781 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.856781 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.857521 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.857521 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.857833 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.858061 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.858326 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.858638 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.858957 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.859268 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.859576 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.859888 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.860222 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.860712 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.861190 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.861714 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.862036 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.862352 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.862668 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.863792 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.863990 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.864245 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.864621 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.864862 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.865172 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.865511 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.866180 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.866648 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.867136 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.867603 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.868083 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.868555 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.869016 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.869495 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.869977 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.870456 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.870925 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.871409 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.871882 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.872349 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.872821 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.873292 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.873765 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.874229 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.874688 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.875162 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.875622 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.876101 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.876573 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.877049 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.877531 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.878025 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.878645 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.879111 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.879601 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.880084 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.880557 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.881017 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.881507 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.881961 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.882602 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.883061 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.883534 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.883997 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.884468 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.884930 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.885400 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.885863 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.886354 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.886812 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.887278 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.887749 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.888212 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.888715 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.889172 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.889729 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.890230 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.890712 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.891201 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.891664 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.892145 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.892629 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.893092 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.893595 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.894063 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.894812 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.895283 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.896417 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.897019 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.897669 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.898264 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.898870 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.899352 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.899834 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.900332 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.900829 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.901473 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.902063 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.902548 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.903135 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.903604 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.904190 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.904648 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.905138 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.905665 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.906132 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.906604 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.907070 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.907544 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.908026 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.908508 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.908974 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.909486 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.910523 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.911043 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.911530 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.911998 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.912480 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.912954 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.913449 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.913924 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.914398 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.914857 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.916010 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.916010 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.916010 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.916238 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.916552 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.917029 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.917549 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.918066 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.918537 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.919018 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.919511 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.919985 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.920487 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.920971 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.921478 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.921935 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.922409 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.922889 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.923346 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.923816 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.924289 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.924787 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.925260 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.926346 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.926820 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.927315 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.927778 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.928244 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.928703 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.929163 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.929674 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.930159 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.930632 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.930997 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.931408 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.931618 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.931931 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.932260 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.932579 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.932899 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.933218 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.933555 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.933873 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.934193 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.934781 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.935124 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.935445 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.935775 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.936103 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.936428 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.936764 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.937396 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.937957 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.938277 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.938618 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.938927 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.939236 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.939571 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.939884 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.940192 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.940498 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.940810 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.941204 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.941559 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.941880 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.942174 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.942491 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.942798 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.943111 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.943415 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.943738 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.944047 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.944352 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.944657 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.944964 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.945311 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.945769 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.946231 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.946571 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.946942 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.947355 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.947786 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.948226 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.948539 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.948848 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.949174 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.949510 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.949820 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.950127 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.950440 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.950766 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.951080 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.951389 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.951692 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.952003 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.952316 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.952641 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 12 13:26:25.953086 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.953176 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 12 13:26:25.953299 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.953585 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.953698 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 12 13:26:25.953794 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.953962 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 12 13:26:25.954167 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.954296 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 12 13:26:25.954384 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.954590 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.954699 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.954899 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.954998 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.955205 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.955340 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.955517 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.955652 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.955927 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.956124 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.956251 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.956434 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.956564 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.956785 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.956916 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.957708 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.957886 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.958044 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.958257 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.958406 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.958548 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.958696 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.958851 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-820027-10-iscsi {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.958972 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.959074 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.959188 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.959361 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.959448 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.959539 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.959630 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.959726 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.959817 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.959906 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.960017 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.960111 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.960202 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.960295 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.960600 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.960771 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.960862 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.961082 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.961214 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.961404 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.961506 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.961708 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.961811 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.962017 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.962125 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.962324 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.962437 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.962630 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.962724 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.962933 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.963027 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.963236 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.963337 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.963539 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.963639 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.963842 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.963946 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.964145 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.964269 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-820027-10-iscsi {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.964467 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.964615 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.964777 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.964881 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.965081 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.965175 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.965399 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.965616 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.965764 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.965932 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.966034 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.966246 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.966392 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.966572 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.966665 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.966909 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.967010 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.967222 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.967328 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.967551 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.967656 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.967876 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.967969 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.968184 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.968284 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.968498 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.968598 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.968822 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.968986 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.969109 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.969218 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.969449 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.969556 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.969762 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.969856 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.970066 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.970184 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.970368 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.970463 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.970662 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.970762 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.970975 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.971075 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.971285 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.971376 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.971605 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.971698 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.971927 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.972029 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.972183 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.972892 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.973059 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.973202 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.973420 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.973517 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.973708 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.973801 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.974016 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.974119 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.974327 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.974418 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.974632 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.974723 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.974944 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.975068 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.975253 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.975351 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.975562 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.975654 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.975868 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.975961 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.976176 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.976268 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.976483 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.976578 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.976791 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.976891 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.977099 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.977193 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.977428 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.977537 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.977754 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.977854 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.978063 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.978154 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.23 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.978367 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.978467 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.23 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.978674 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.978768 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.978977 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.979070 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.979283 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.979388 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.979586 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.979679 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.979932 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.980023 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.980318 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.980519 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.980631 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.980727 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.980936 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.981105 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.981246 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.981485 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.981593 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.981886 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.982023 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.982197 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.982303 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.982500 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.982667 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.982913 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.983005 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.983229 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.983424 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.983565 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.983748 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.983870 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.984120 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.984296 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.984461 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.984621 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.984761 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.984899 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.985040 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.985174 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.985308 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.985437 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.985639 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.985732 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.985942 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.986035 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.986265 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.986361 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.986566 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.986659 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.986886 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.986985 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.987199 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.987298 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.987510 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.987617 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.987818 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.988746 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.988838 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.988930 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.989009 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.989227 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.989336 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.989564 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.989673 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.989888 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.989989 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.990211 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.990311 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.990527 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.990643 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.990832 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.990981 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.991145 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.991241 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.991451 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.991553 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.991772 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.991877 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.992076 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.992177 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.992382 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.992482 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.992695 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.992795 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.992999 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.993092 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.993312 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.993451 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.993655 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.993769 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.993958 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.994058 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.994267 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.994358 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.994592 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.994683 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.994902 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.995001 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.995212 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.995380 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.995550 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.995684 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.995850 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.995987 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.996136 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.996284 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.996391 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.996709 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.996864 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.997007 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.997153 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.997304 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.997508 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.997607 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.997700 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.997791 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.997905 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.998013 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.998215 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.998322 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.998522 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.998615 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.998830 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.998940 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.999135 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.999279 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:25.999437 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.999532 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.999758 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:25.999859 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.000059 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.000205 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.000378 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.000588 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.000791 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.000930 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.001069 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.001285 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.001407 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.001613 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.001716 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.001931 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.002024 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.002235 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.002331 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.002540 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.002635 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.002842 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.002943 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.003144 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.003244 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.003464 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.004115 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.004314 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.004416 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.004671 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.004798 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.005003 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.005139 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.005327 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.005497 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.005689 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.005794 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.006012 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.006107 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.006329 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.006443 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.006727 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.006914 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.007068 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.007207 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.007356 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.007501 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.007649 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.007815 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.007967 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.008164 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.008311 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.008523 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.008668 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.008814 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.008952 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.009115 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.009270 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.009494 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.009594 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.009734 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.009858 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.010036 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.010176 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.010338 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.010493 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.010660 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.010860 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.010955 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.011272 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.011371 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.011579 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.011673 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.011884 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.011985 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.012185 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.012366 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.012471 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.012687 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.012816 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.013003 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.013122 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.013320 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.013526 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.013683 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.013813 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.014025 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.014137 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.014342 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.014444 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.014668 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.014811 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.015004 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.015118 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.015320 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.015428 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.015635 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.015822 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.015946 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.016217 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.016332 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.016541 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.016645 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.016852 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.016953 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.017164 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.017268 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.017498 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.017612 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.017810 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.017900 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.018118 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.018217 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.018431 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.018520 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.018760 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.018991 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.019212 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.019500 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.019650 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.019862 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.019988 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.020183 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.020298 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.020499 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.020633 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.020810 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.020966 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.021125 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.021313 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.021469 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.021654 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.021811 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.021960 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.022125 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.022269 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.022449 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.022613 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.022764 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.022950 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.023112 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.023275 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.023427 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.023574 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.023711 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.023855 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.023963 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.024056 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.024238 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.024366 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.024550 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.024686 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.024863 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.025005 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.025216 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.025319 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.025555 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.025682 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.025866 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.025991 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.026181 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.026278 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.026502 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.026617 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.026817 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.026909 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.027128 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.027219 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.027440 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.027532 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.027752 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.027843 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.028061 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.028158 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.028371 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.028464 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.028678 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.028769 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.028988 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.029079 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.029298 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.029412 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.029646 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.029748 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.029956 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.030109 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.030259 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.030402 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.030561 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.030711 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.030905 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.031053 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.031151 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.031243 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.031434 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.031682 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.031776 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.031994 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.032087 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.032322 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.032423 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.032639 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.032733 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.032945 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.033039 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.033251 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.033434 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.033593 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.033696 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.033917 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.034012 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.034221 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.034321 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.034526 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.034628 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.035358 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.035496 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.035667 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.036086 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.036241 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.036390 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.036607 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.036705 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.036799 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.036956 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.037059 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.037199 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.037367 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.037612 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.037727 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.038003 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.038106 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.038335 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.038436 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.038655 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.038749 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.038983 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.039090 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.039299 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.039399 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.039620 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.039711 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.039929 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.040032 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.040251 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.040344 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.040557 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.040650 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.040861 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.040963 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.041173 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.041269 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.041507 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.041649 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.041812 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.041926 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.042114 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.042207 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.042423 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.042516 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.042729 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.042820 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.043030 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.043131 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.043336 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.043437 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.043636 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.043729 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.043961 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.044097 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.044266 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.044360 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.044571 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.044665 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.044874 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.044975 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.045185 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.045322 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.045515 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.045634 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.045803 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.046025 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.046131 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.046355 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.046468 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.046668 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.046803 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.046981 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.047086 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.047289 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.047404 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.047592 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.047694 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.047900 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.047994 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.048205 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.048315 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.048560 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.048668 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.048848 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.048940 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.049165 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.049258 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.049489 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.049584 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.049793 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.049905 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.050099 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.050198 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.050497 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.051100 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.051325 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.051505 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.051624 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.051716 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.051935 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.052043 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.052242 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.052344 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.052563 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.052665 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.052880 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.053100 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.053201 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.053463 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.053571 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.053786 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.053890 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.054120 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.054267 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.054451 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.054552 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.054756 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.054897 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.055054 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.055235 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.055357 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.055547 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.055658 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.055857 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.055964 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.056186 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.056279 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.056503 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.056616 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.056819 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.057020 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.057157 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.057257 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.057442 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.057547 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.057764 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.057921 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.058071 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.058198 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.058382 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.058524 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.058683 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.058784 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.058987 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.059079 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.059293 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.059395 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.059600 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.059692 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.059912 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.060005 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.060251 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.060352 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.060572 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.060685 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.060889 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.061009 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.061201 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.061424 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.061578 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.061659 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.061865 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.062292 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.062440 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.062615 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.062763 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.062991 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.063099 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.063305 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.063415 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.063620 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.063718 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.063929 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.064027 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.064328 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.064443 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.064525 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.064652 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.064845 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.064949 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.065468 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.065592 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.065592 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.065780 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.065945 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.066730 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.066977 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.067114 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.067494 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.067644 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.067851 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.068029 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.068186 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.068340 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.068507 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.068692 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.068847 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.069000 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.069166 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.069320 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.069452 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.069542 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.069793 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.069901 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.070100 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.070193 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.070404 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.070507 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.070712 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.070811 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.071029 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.071128 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.071334 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.071436 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.071640 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.071745 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.071941 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.072102 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.072249 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.072370 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.072552 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.072670 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.072859 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.072969 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.073159 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.073276 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.073502 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.073736 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.073830 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.074051 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.074182 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.074383 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.074499 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.074662 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.074794 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.074967 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.075193 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.075290 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.075520 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.075652 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.075856 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.075955 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.076162 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.076297 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.076468 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.076564 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.076771 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.076901 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.077075 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.077211 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.077407 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.077577 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.077706 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.077913 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.078038 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.078264 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.078355 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.078577 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.078675 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.078901 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.079032 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.079279 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.079380 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.079593 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.079702 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.079898 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.079988 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.080205 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.080303 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.080519 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.080620 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.080831 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.080922 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.081136 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.081227 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.081475 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.081584 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.082482 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.082627 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.082819 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.082947 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.083097 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.083269 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.083422 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.083581 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.083744 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.083896 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.084067 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.084172 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.084304 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.084397 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.084636 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.084752 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.084936 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.085029 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.085256 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.085355 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.085595 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.085699 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.085909 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.086012 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.086217 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.086309 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.086525 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.086616 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.086829 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.086928 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.087153 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.087314 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.087470 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.087577 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.087762 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.087854 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.088069 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.088161 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.088378 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.088479 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.088693 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.088784 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.088998 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.089098 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.089323 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.089448 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.089664 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.089765 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.089974 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.090073 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.090288 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.090386 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.090604 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.090703 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.090916 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.091006 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.091226 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.091330 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.091541 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.091639 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.091869 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.091969 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.092187 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.092277 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.092492 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.092582 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.092794 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.092887 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.093038 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 12 13:26:26.093131 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.093438 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.093723 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.094116 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.094425 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.094807 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.095188 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.095503 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.095812 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.096143 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.096455 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.096765 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.097073 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.097451 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.097960 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.098402 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.098852 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.099169 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.099492 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.099822 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.100142 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.100458 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.100818 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.101184 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.101553 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.101933 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.102329 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.102637 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.102947 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.103284 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.103604 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.103921 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.104250 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.104579 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.104909 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.105224 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.105568 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.105885 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.106198 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.106608 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.106964 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.107314 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.107711 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.108105 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.108499 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.108816 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.109131 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.109472 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.109789 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.110103 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.110443 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.110758 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.111069 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.111383 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.111692 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.112006 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.112318 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.112768 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.113192 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.113706 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.114018 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.114333 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.114650 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.115011 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.115441 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.115823 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.116333 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.116738 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.117129 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.117570 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.117954 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.118336 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.118731 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.119139 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.119530 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.119911 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.120301 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.120870 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.121256 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.121682 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.122269 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.122662 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.123047 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.123567 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.123922 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.124241 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.124575 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.124905 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.125237 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.125581 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.125905 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.126219 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.126552 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.126878 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.127197 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.127517 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.127825 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.128154 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.128992 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.129355 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.129759 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.130306 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.130640 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.130959 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.131288 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.131625 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.131936 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.132245 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.132562 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.132873 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.133195 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.133617 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.133930 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.134246 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.134562 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.134874 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.135199 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.135489 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.135821 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.136129 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.136456 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.136776 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.137100 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.137451 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.137761 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.138084 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.138397 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.138706 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.139014 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.139320 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.139668 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.139978 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.140303 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.140639 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.140978 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.141293 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.141903 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.142244 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.142570 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.142893 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.143224 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.143765 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.143945 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.144178 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.145109 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.145694 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.146023 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.146342 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.146653 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.146964 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.147273 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.147607 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.147917 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.148244 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.148557 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.148867 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.149177 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.149509 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.149864 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.150174 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.150519 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.150844 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.151171 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.151508 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.151911 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.152148 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.152469 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.152927 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.153255 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.153600 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.153928 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.154247 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.154566 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.154880 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.155198 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.155596 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.155841 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.156431 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.156760 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.157077 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.157413 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.157734 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.158054 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.158373 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.158688 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.159002 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.159315 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.159629 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.160064 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.160390 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.160837 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.161187 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.161546 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.161952 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.162283 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.162732 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.163108 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.163449 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.163747 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.164066 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.164388 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.164711 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.165030 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.165349 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.165694 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.166012 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.166328 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.166643 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.166960 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.167277 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.167611 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.167951 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.168385 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.168704 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.169099 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.169500 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.170087 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.170405 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.170743 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.171076 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.171407 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.171729 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.172052 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.172388 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.172699 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.173004 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.173316 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.173653 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.173964 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.174287 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.174602 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.174910 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.175230 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.176284 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.176954 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.177317 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.177668 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.178006 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.178414 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.178746 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.179064 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.179397 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.179712 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.180024 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.180346 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.180668 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.180980 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.181290 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.181635 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.181951 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.182261 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.182575 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.182889 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.183219 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.183530 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.183842 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.184154 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.184469 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.184842 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.185166 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.185503 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.185818 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.186146 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.186453 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.186767 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.187341 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.187658 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.187966 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.188277 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.188638 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.188971 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.189282 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.189615 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.189941 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.190254 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.190582 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.190898 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.191781 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.192215 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.192539 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.193114 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.193472 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.193798 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.194225 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.194563 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.194950 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.195269 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.195643 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.196045 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.196369 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.196682 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.196997 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.197313 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.197655 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.197969 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.198282 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.198596 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.198906 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.199218 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.199528 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.199840 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.200150 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.200467 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.200811 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.201131 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.201475 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.201869 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.202195 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.202587 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.202905 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.203223 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.204164 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.204164 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.204164 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.204656 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.204802 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.205192 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.205540 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.205867 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.206200 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.206516 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.206870 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.207203 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.207516 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.207838 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.208154 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.208489 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.208913 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.209324 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.209684 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.209996 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.210306 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.210617 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.210932 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.211256 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.211572 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.211881 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.212189 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.212501 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.212808 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.213115 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.213441 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.213752 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.214063 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.214382 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.214677 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.214985 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.215291 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.215597 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.215906 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.216219 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.216529 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.216833 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.217142 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.217475 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.217786 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.218123 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.218461 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.218781 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.219109 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.219426 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.219753 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.220063 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.220388 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.220713 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.221032 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.221344 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.221704 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.222021 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.222416 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.222730 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.223087 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.223786 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.223786 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.224137 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.224622 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.224859 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.225266 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.225665 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.226017 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.226415 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.226740 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.227075 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.227394 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.229912 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.229912 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.229912 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.229912 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.229912 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.229912 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.229912 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.229912 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.230596 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.230681 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.231002 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.231418 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.231744 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.232096 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.232431 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.232754 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.233073 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.233394 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:26.233652 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 12 13:26:26.243593 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO dbcounter [None req-cb5b7f06-fa6a-458c-922d-31f056bba20c None None] Registered counter for database nova_api Jul 12 13:26:26.265121 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_db.sqlalchemy.engines [None req-cb5b7f06-fa6a-458c-922d-31f056bba20c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117987) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 13:26:26.273145 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG dbcounter [-] [117987] Writer thread running {{(pid=117987) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 13:26:26.331990 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.context [None req-cb5b7f06-fa6a-458c-922d-31f056bba20c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1699b324-b37f-4b24-822a-271bd58456f2(cell1) {{(pid=117987) load_cells /opt/stack/nova/nova/context.py:464}} Jul 12 13:26:26.336202 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-cb5b7f06-fa6a-458c-922d-31f056bba20c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:26:26.337919 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-cb5b7f06-fa6a-458c-922d-31f056bba20c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:26:26.338902 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-cb5b7f06-fa6a-458c-922d-31f056bba20c None None] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:26:26.340858 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-cb5b7f06-fa6a-458c-922d-31f056bba20c None None] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:26:26.342906 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO dbcounter [None req-cb5b7f06-fa6a-458c-922d-31f056bba20c None None] Registered counter for database nova_cell0 Jul 12 13:26:26.347345 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO dbcounter [None req-cb5b7f06-fa6a-458c-922d-31f056bba20c None None] Registered counter for database nova_cell1 Jul 12 13:26:26.356556 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_db.sqlalchemy.engines [None req-cb5b7f06-fa6a-458c-922d-31f056bba20c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117987) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 13:26:26.357953 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_db.sqlalchemy.engines [None req-cb5b7f06-fa6a-458c-922d-31f056bba20c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117987) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 13:26:26.368903 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG dbcounter [-] [117987] Writer thread running {{(pid=117987) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 13:26:26.369467 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG dbcounter [-] [117987] Writer thread running {{(pid=117987) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 13:26:26.386606 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO dbcounter [None req-1e8d6abd-ebb8-4c80-ad7e-943ec6a51184 None None] Registered counter for database nova_api Jul 12 13:26:26.406949 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_db.sqlalchemy.engines [None req-1e8d6abd-ebb8-4c80-ad7e-943ec6a51184 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117988) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 13:26:26.415080 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG dbcounter [-] [117988] Writer thread running {{(pid=117988) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 13:26:26.472687 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.context [None req-1e8d6abd-ebb8-4c80-ad7e-943ec6a51184 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1699b324-b37f-4b24-822a-271bd58456f2(cell1) {{(pid=117988) load_cells /opt/stack/nova/nova/context.py:464}} Jul 12 13:26:26.476724 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-1e8d6abd-ebb8-4c80-ad7e-943ec6a51184 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:26:26.478342 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-1e8d6abd-ebb8-4c80-ad7e-943ec6a51184 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:26:26.479178 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-1e8d6abd-ebb8-4c80-ad7e-943ec6a51184 None None] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:26:26.481153 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-1e8d6abd-ebb8-4c80-ad7e-943ec6a51184 None None] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:26:26.483195 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO dbcounter [None req-1e8d6abd-ebb8-4c80-ad7e-943ec6a51184 None None] Registered counter for database nova_cell0 Jul 12 13:26:26.487523 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO dbcounter [None req-1e8d6abd-ebb8-4c80-ad7e-943ec6a51184 None None] Registered counter for database nova_cell1 Jul 12 13:26:26.495909 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_db.sqlalchemy.engines [None req-1e8d6abd-ebb8-4c80-ad7e-943ec6a51184 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117988) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 13:26:26.498389 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_db.sqlalchemy.engines [None req-1e8d6abd-ebb8-4c80-ad7e-943ec6a51184 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117988) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 13:26:26.506646 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG dbcounter [-] [117988] Writer thread running {{(pid=117988) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 13:26:26.508462 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG dbcounter [-] [117988] Writer thread running {{(pid=117988) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 13:26:26.519845 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO dbcounter [None req-cb5b7f06-fa6a-458c-922d-31f056bba20c None None] Registered counter for database nova_cell0 Jul 12 13:26:26.527056 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_db.sqlalchemy.engines [None req-cb5b7f06-fa6a-458c-922d-31f056bba20c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117987) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 13:26:26.531739 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG dbcounter [-] [117987] Writer thread running {{(pid=117987) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 13:26:26.658575 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO dbcounter [None req-1e8d6abd-ebb8-4c80-ad7e-943ec6a51184 None None] Registered counter for database nova_cell0 Jul 12 13:26:26.666641 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_db.sqlalchemy.engines [None req-1e8d6abd-ebb8-4c80-ad7e-943ec6a51184 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117988) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 13:26:26.671515 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG dbcounter [-] [117988] Writer thread running {{(pid=117988) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 13:26:26.867182 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: WARNING keystonemiddleware.auth_token [None req-cb5b7f06-fa6a-458c-922d-31f056bba20c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 12 13:26:26.874513 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: WARNING keystonemiddleware.auth_token [None req-cb5b7f06-fa6a-458c-922d-31f056bba20c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 12 13:26:27.010292 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: WARNING keystonemiddleware.auth_token [None req-1e8d6abd-ebb8-4c80-ad7e-943ec6a51184 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 12 13:26:27.018234 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: WARNING keystonemiddleware.auth_token [None req-1e8d6abd-ebb8-4c80-ad7e-943ec6a51184 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 12 13:26:27.246680 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: WARNING keystonemiddleware.auth_token [None req-cb5b7f06-fa6a-458c-922d-31f056bba20c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 12 13:26:27.256786 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: WARNING keystonemiddleware.auth_token [None req-cb5b7f06-fa6a-458c-922d-31f056bba20c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 12 13:26:27.262296 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x557f457b99c0 pid: 117987 (default app) Jul 12 13:26:27.370534 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: WARNING keystonemiddleware.auth_token [None req-1e8d6abd-ebb8-4c80-ad7e-943ec6a51184 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 12 13:26:27.376510 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: WARNING keystonemiddleware.auth_token [None req-1e8d6abd-ebb8-4c80-ad7e-943ec6a51184 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 12 13:26:27.382489 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x557f457b99c0 pid: 117988 (default app) Jul 12 13:27:10.675990 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG dbcounter [-] [117987] Writing DB stats nova_api:SELECT=3 {{(pid=117987) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:10.677222 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG dbcounter [-] [117987] Writing DB stats nova_cell0:SELECT=3 {{(pid=117987) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:10.678408 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG dbcounter [-] [117987] Writing DB stats nova_cell1:SELECT=3 {{(pid=117987) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:10.679411 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG dbcounter [-] [117987] Writing DB stats nova_cell0:SELECT=3 {{(pid=117987) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:13.086331 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-70b03b30-c9d1-43a1-ae7a-7b2a88ffd143 tempest-VolumesNegativeTest-1775942397 tempest-VolumesNegativeTest-1775942397-project] Action: 'create', calling method: .version_select at 0x7f76eb9915e0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-465494021", "metadata": {"Type": "work"}}} {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:27:13.129024 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-70b03b30-c9d1-43a1-ae7a-7b2a88ffd143 tempest-VolumesNegativeTest-1775942397 tempest-VolumesNegativeTest-1775942397-project] Request method failure captured: Jul 12 13:27:13.129024 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 12 13:27:13.129024 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: Accept: application/json Jul 12 13:27:13.129024 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: Accept-Encoding: identity Jul 12 13:27:13.129024 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: Connection: close Jul 12 13:27:13.129024 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: Content-Length: 121 Jul 12 13:27:13.129024 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: Content-Type: application/json Jul 12 13:27:13.129024 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: Host: 10.222.0.23 Jul 12 13:27:13.129024 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: Openstack-System-Scope: None Jul 12 13:27:13.129024 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: User-Agent: python-urllib3/1.26.9 Jul 12 13:27:13.129024 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Auth-Token: gAAAAABizXaupU6UCO4iP8ikK6p2ksEdCWlJUtBRYc7f3Z_sI8kq8hpYTET2_3y3VWcaYC5C4tJeUvQ3GgfPYQB-H5GoSPSFr58_O_tkbutDfknUFaLX-ovbLRu3Kxwjchk7ak2-TzODhEu52NLc_KW_w0udjIWbu8Wcg9-nVcAw5Jtz80Ik590 Jul 12 13:27:13.129024 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Domain-Id: None Jul 12 13:27:13.129024 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Domain-Name: None Jul 12 13:27:13.129024 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Identity-Status: Confirmed Jul 12 13:27:13.129024 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Is-Admin-Project: True Jul 12 13:27:13.129024 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Project-Domain-Id: default Jul 12 13:27:13.129024 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Project-Domain-Name: Default Jul 12 13:27:13.129024 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Project-Id: d75bcce87627476fa9be86774325d62d Jul 12 13:27:13.129024 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Project-Name: tempest-VolumesNegativeTest-1775942397 Jul 12 13:27:13.129024 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Role: reader,member Jul 12 13:27:13.129024 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Roles: reader,member Jul 12 13:27:13.130734 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d75bcce87627476fa9be86774325d62d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d75bcce87627476fa9be86774325d62d", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d75bcce87627476fa9be86774325d62d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d75bcce87627476fa9be86774325d62d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] Jul 12 13:27:13.130734 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Tenant: tempest-VolumesNegativeTest-1775942397 Jul 12 13:27:13.130734 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Tenant-Id: d75bcce87627476fa9be86774325d62d Jul 12 13:27:13.130734 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Tenant-Name: tempest-VolumesNegativeTest-1775942397 Jul 12 13:27:13.130734 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-User: tempest-VolumesNegativeTest-1775942397-project Jul 12 13:27:13.130734 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-User-Domain-Id: default Jul 12 13:27:13.130734 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-User-Domain-Name: Default Jul 12 13:27:13.130734 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-User-Id: 6161475cb848468e92eed1a657e2c835 Jul 12 13:27:13.130734 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-User-Name: tempest-VolumesNegativeTest-1775942397-project Jul 12 13:27:13.130734 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: Jul 12 13:27:13.130734 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-465494021", "metadata": {"Type": "work"}}} Jul 12 13:27:13.130734 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: method: Jul 12 13:27:13.130734 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 12 13:27:13.131840 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-465494021', 'metadata': {'Type': 'work'}}}} Jul 12 13:27:13.131840 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 13:27:13.131840 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:27:13.131840 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 12 13:27:13.131840 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 12 13:27:13.131840 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 12 13:27:13.131840 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi raise error Jul 12 13:27:13.131840 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 12 13:27:13.131840 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi Jul 12 13:27:13.131840 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 12 13:27:13.131840 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 12 13:27:13.131840 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi Jul 12 13:27:13.131840 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 12 13:27:13.131840 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi '#$%' Jul 12 13:27:13.131840 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi Jul 12 13:27:13.131840 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:27:13.131840 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi Jul 12 13:27:13.131840 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:27:13.131840 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:27:13.131840 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:27:13.131840 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 13:27:13.131840 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 13:27:13.137792 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 13:27:13.137792 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 13:27:13.137792 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 13:27:13.137792 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:27:13.137792 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 12 13:27:13.137792 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 12 13:27:13.137792 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 12 13:27:13.137792 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 12 13:27:13.137792 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 12 13:27:13.137792 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 12 13:27:13.137792 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 12 13:27:13.137792 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi Jul 12 13:27:13.137792 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:27:13.137792 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi Jul 12 13:27:13.137792 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:27:13.137792 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:27:13.137792 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:27:13.137792 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 12 13:27:13.137792 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 12 13:27:13.139244 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 12 13:27:13.139244 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi Jul 12 13:27:13.139244 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-70b03b30-c9d1-43a1-ae7a-7b2a88ffd143 tempest-VolumesNegativeTest-1775942397 tempest-VolumesNegativeTest-1775942397-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117987) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 13:27:13.139244 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-70b03b30-c9d1-43a1-ae7a-7b2a88ffd143 tempest-VolumesNegativeTest-1775942397 tempest-VolumesNegativeTest-1775942397-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 2.465213 Jul 12 13:27:13.139244 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 1/1] 10.222.0.23 () {60 vars in 1155 bytes} [Tue Jul 12 13:27:10 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 2473 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 12 13:27:13.667718 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-517ff68c-b364-44e6-9a4e-438648858f4c tempest-VolumesNegativeTest-1775942397 tempest-VolumesNegativeTest-1775942397-project] Action: 'create', calling method: .version_select at 0x7f76eba42160>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-607626566", "metadata": {"Type": "work"}}} {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:27:13.681413 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-517ff68c-b364-44e6-9a4e-438648858f4c tempest-VolumesNegativeTest-1775942397 tempest-VolumesNegativeTest-1775942397-project] Request method failure captured: Jul 12 13:27:13.681413 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 12 13:27:13.681413 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: Accept: application/json Jul 12 13:27:13.681413 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: Accept-Encoding: identity Jul 12 13:27:13.681413 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: Connection: close Jul 12 13:27:13.681413 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: Content-Length: 119 Jul 12 13:27:13.681413 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: Content-Type: application/json Jul 12 13:27:13.681413 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: Host: 10.222.0.23 Jul 12 13:27:13.681413 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: Openstack-System-Scope: None Jul 12 13:27:13.681413 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: User-Agent: python-urllib3/1.26.9 Jul 12 13:27:13.681413 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Auth-Token: gAAAAABizXaupU6UCO4iP8ikK6p2ksEdCWlJUtBRYc7f3Z_sI8kq8hpYTET2_3y3VWcaYC5C4tJeUvQ3GgfPYQB-H5GoSPSFr58_O_tkbutDfknUFaLX-ovbLRu3Kxwjchk7ak2-TzODhEu52NLc_KW_w0udjIWbu8Wcg9-nVcAw5Jtz80Ik590 Jul 12 13:27:13.681413 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Domain-Id: None Jul 12 13:27:13.681413 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Domain-Name: None Jul 12 13:27:13.681413 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Identity-Status: Confirmed Jul 12 13:27:13.681413 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Is-Admin-Project: True Jul 12 13:27:13.681413 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Project-Domain-Id: default Jul 12 13:27:13.681413 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Project-Domain-Name: Default Jul 12 13:27:13.681413 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Project-Id: d75bcce87627476fa9be86774325d62d Jul 12 13:27:13.681413 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Project-Name: tempest-VolumesNegativeTest-1775942397 Jul 12 13:27:13.681413 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Role: reader,member Jul 12 13:27:13.681413 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Roles: reader,member Jul 12 13:27:13.683456 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d75bcce87627476fa9be86774325d62d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d75bcce87627476fa9be86774325d62d", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d75bcce87627476fa9be86774325d62d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d75bcce87627476fa9be86774325d62d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] Jul 12 13:27:13.683456 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Tenant: tempest-VolumesNegativeTest-1775942397 Jul 12 13:27:13.683456 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Tenant-Id: d75bcce87627476fa9be86774325d62d Jul 12 13:27:13.683456 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Tenant-Name: tempest-VolumesNegativeTest-1775942397 Jul 12 13:27:13.683456 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-User: tempest-VolumesNegativeTest-1775942397-project Jul 12 13:27:13.683456 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-User-Domain-Id: default Jul 12 13:27:13.683456 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-User-Domain-Name: Default Jul 12 13:27:13.683456 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-User-Id: 6161475cb848468e92eed1a657e2c835 Jul 12 13:27:13.683456 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-User-Name: tempest-VolumesNegativeTest-1775942397-project Jul 12 13:27:13.683456 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: Jul 12 13:27:13.683456 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-607626566", "metadata": {"Type": "work"}}} Jul 12 13:27:13.683456 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: method: Jul 12 13:27:13.683456 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 12 13:27:13.684846 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-607626566', 'metadata': {'Type': 'work'}}}} Jul 12 13:27:13.684846 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 13:27:13.684846 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:27:13.684846 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 12 13:27:13.684846 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 12 13:27:13.684846 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 12 13:27:13.684846 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi raise error Jul 12 13:27:13.684846 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 12 13:27:13.684846 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi Jul 12 13:27:13.684846 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 12 13:27:13.684846 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 12 13:27:13.684846 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi Jul 12 13:27:13.684846 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 12 13:27:13.684846 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi '0' Jul 12 13:27:13.684846 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi Jul 12 13:27:13.684846 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:27:13.684846 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi Jul 12 13:27:13.684846 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:27:13.684846 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:27:13.684846 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:27:13.684846 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 13:27:13.684846 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 13:27:13.687284 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 13:27:13.687284 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 13:27:13.687284 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 13:27:13.687284 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:27:13.687284 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 12 13:27:13.687284 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 12 13:27:13.687284 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 12 13:27:13.687284 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 12 13:27:13.687284 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 12 13:27:13.687284 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 12 13:27:13.687284 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 12 13:27:13.687284 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi Jul 12 13:27:13.687284 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:27:13.687284 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi Jul 12 13:27:13.687284 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:27:13.687284 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:27:13.687284 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:27:13.687284 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 12 13:27:13.687284 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 12 13:27:13.690921 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 12 13:27:13.690921 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi Jul 12 13:27:13.690921 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-517ff68c-b364-44e6-9a4e-438648858f4c tempest-VolumesNegativeTest-1775942397 tempest-VolumesNegativeTest-1775942397-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117988) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 13:27:13.690921 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-517ff68c-b364-44e6-9a4e-438648858f4c tempest-VolumesNegativeTest-1775942397 tempest-VolumesNegativeTest-1775942397-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.544988 Jul 12 13:27:13.699055 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-f0c98772-aa5c-4369-abc8-7ddc488db330 tempest-VolumesNegativeTest-1775942397 tempest-VolumesNegativeTest-1775942397-project] Action: 'create', calling method: .version_select at 0x7f76eb91c940>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-2033747254", "metadata": {"Type": "work"}}} {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:27:13.702730 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-f0c98772-aa5c-4369-abc8-7ddc488db330 tempest-VolumesNegativeTest-1775942397 tempest-VolumesNegativeTest-1775942397-project] Request method failure captured: Jul 12 13:27:13.702730 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 12 13:27:13.702730 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: Accept: application/json Jul 12 13:27:13.702730 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: Accept-Encoding: identity Jul 12 13:27:13.702730 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: Connection: close Jul 12 13:27:13.702730 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: Content-Length: 119 Jul 12 13:27:13.702730 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: Content-Type: application/json Jul 12 13:27:13.702730 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: Host: 10.222.0.23 Jul 12 13:27:13.702730 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: Openstack-System-Scope: None Jul 12 13:27:13.702730 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: User-Agent: python-urllib3/1.26.9 Jul 12 13:27:13.702730 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Auth-Token: gAAAAABizXaupU6UCO4iP8ikK6p2ksEdCWlJUtBRYc7f3Z_sI8kq8hpYTET2_3y3VWcaYC5C4tJeUvQ3GgfPYQB-H5GoSPSFr58_O_tkbutDfknUFaLX-ovbLRu3Kxwjchk7ak2-TzODhEu52NLc_KW_w0udjIWbu8Wcg9-nVcAw5Jtz80Ik590 Jul 12 13:27:13.702730 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Domain-Id: None Jul 12 13:27:13.702730 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Domain-Name: None Jul 12 13:27:13.702730 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Identity-Status: Confirmed Jul 12 13:27:13.702730 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Is-Admin-Project: True Jul 12 13:27:13.702730 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Project-Domain-Id: default Jul 12 13:27:13.702730 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Project-Domain-Name: Default Jul 12 13:27:13.702730 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Project-Id: d75bcce87627476fa9be86774325d62d Jul 12 13:27:13.702730 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Project-Name: tempest-VolumesNegativeTest-1775942397 Jul 12 13:27:13.702730 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Role: reader,member Jul 12 13:27:13.702730 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Roles: reader,member Jul 12 13:27:13.704583 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d75bcce87627476fa9be86774325d62d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d75bcce87627476fa9be86774325d62d", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d75bcce87627476fa9be86774325d62d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d75bcce87627476fa9be86774325d62d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] Jul 12 13:27:13.704583 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Tenant: tempest-VolumesNegativeTest-1775942397 Jul 12 13:27:13.704583 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Tenant-Id: d75bcce87627476fa9be86774325d62d Jul 12 13:27:13.704583 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Tenant-Name: tempest-VolumesNegativeTest-1775942397 Jul 12 13:27:13.704583 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-User: tempest-VolumesNegativeTest-1775942397-project Jul 12 13:27:13.704583 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-User-Domain-Id: default Jul 12 13:27:13.704583 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-User-Domain-Name: Default Jul 12 13:27:13.704583 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-User-Id: 6161475cb848468e92eed1a657e2c835 Jul 12 13:27:13.704583 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-User-Name: tempest-VolumesNegativeTest-1775942397-project Jul 12 13:27:13.704583 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: Jul 12 13:27:13.704583 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-2033747254", "metadata": {"Type": "work"}}} Jul 12 13:27:13.704583 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: method: Jul 12 13:27:13.704583 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 12 13:27:13.706394 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-2033747254', 'metadata': {'Type': 'work'}}}} Jul 12 13:27:13.706394 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 13:27:13.706394 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:27:13.706394 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 12 13:27:13.706394 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 12 13:27:13.706394 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 12 13:27:13.706394 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi raise error Jul 12 13:27:13.706394 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 12 13:27:13.706394 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi Jul 12 13:27:13.706394 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 12 13:27:13.706394 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 12 13:27:13.706394 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi Jul 12 13:27:13.706394 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 12 13:27:13.706394 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi '' Jul 12 13:27:13.706394 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi Jul 12 13:27:13.706394 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:27:13.706394 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi Jul 12 13:27:13.706394 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:27:13.706394 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:27:13.706394 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:27:13.706394 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 13:27:13.706394 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 13:27:13.710914 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 13:27:13.710914 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 13:27:13.710914 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 13:27:13.710914 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:27:13.710914 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 12 13:27:13.710914 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 12 13:27:13.710914 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 12 13:27:13.710914 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 12 13:27:13.710914 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 12 13:27:13.710914 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 12 13:27:13.710914 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 12 13:27:13.710914 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi Jul 12 13:27:13.710914 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:27:13.710914 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi Jul 12 13:27:13.710914 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:27:13.710914 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:27:13.710914 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:27:13.710914 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 12 13:27:13.710914 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 12 13:27:13.713781 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 12 13:27:13.713781 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi Jul 12 13:27:13.713781 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-f0c98772-aa5c-4369-abc8-7ddc488db330 tempest-VolumesNegativeTest-1775942397 tempest-VolumesNegativeTest-1775942397-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117987) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 13:27:13.714240 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 1/2] 10.222.0.23 () {60 vars in 1155 bytes} [Tue Jul 12 13:27:13 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 567 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 12 13:27:13.714398 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-f0c98772-aa5c-4369-abc8-7ddc488db330 tempest-VolumesNegativeTest-1775942397 tempest-VolumesNegativeTest-1775942397-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.011003 Jul 12 13:27:13.714398 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 2/3] 10.222.0.23 () {60 vars in 1155 bytes} [Tue Jul 12 13:27:13 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 12 13:27:13.717420 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG dbcounter [-] [117988] Writing DB stats nova_api:SELECT=3 {{(pid=117988) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:13.717662 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG dbcounter [-] [117988] Writing DB stats nova_cell1:SELECT=3 {{(pid=117988) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:13.718705 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG dbcounter [-] [117988] Writing DB stats nova_cell0:SELECT=3 {{(pid=117988) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:13.724932 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG dbcounter [-] [117988] Writing DB stats nova_cell0:SELECT=3 {{(pid=117988) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:13.738026 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-67b2c129-35e2-4afa-af6e-0067cb03c6cc tempest-VolumesNegativeTest-1775942397 tempest-VolumesNegativeTest-1775942397-project] Calling method '.version_select at 0x7f76eba42160>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:27:14.590846 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.wsgi [None req-67b2c129-35e2-4afa-af6e-0067cb03c6cc tempest-VolumesNegativeTest-1775942397 tempest-VolumesNegativeTest-1775942397-project] HTTP exception thrown: Volume tempest-invalid-1911202847 could not be found. Jul 12 13:27:14.594824 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-67b2c129-35e2-4afa-af6e-0067cb03c6cc tempest-VolumesNegativeTest-1775942397 tempest-VolumesNegativeTest-1775942397-project] Request method failure captured: Jul 12 13:27:14.594824 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1911202847 HTTP/1.1 Jul 12 13:27:14.594824 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: Accept: application/json Jul 12 13:27:14.594824 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: Accept-Encoding: identity Jul 12 13:27:14.594824 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: Connection: close Jul 12 13:27:14.594824 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: Content-Length: 0 Jul 12 13:27:14.594824 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: Content-Type: application/json Jul 12 13:27:14.594824 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: Host: 10.222.0.23 Jul 12 13:27:14.594824 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: Openstack-System-Scope: None Jul 12 13:27:14.594824 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: User-Agent: python-urllib3/1.26.9 Jul 12 13:27:14.594824 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Auth-Token: gAAAAABizXaupU6UCO4iP8ikK6p2ksEdCWlJUtBRYc7f3Z_sI8kq8hpYTET2_3y3VWcaYC5C4tJeUvQ3GgfPYQB-H5GoSPSFr58_O_tkbutDfknUFaLX-ovbLRu3Kxwjchk7ak2-TzODhEu52NLc_KW_w0udjIWbu8Wcg9-nVcAw5Jtz80Ik590 Jul 12 13:27:14.594824 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Domain-Id: None Jul 12 13:27:14.594824 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Domain-Name: None Jul 12 13:27:14.594824 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Identity-Status: Confirmed Jul 12 13:27:14.594824 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Is-Admin-Project: True Jul 12 13:27:14.594824 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Project-Domain-Id: default Jul 12 13:27:14.594824 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Project-Domain-Name: Default Jul 12 13:27:14.594824 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Project-Id: d75bcce87627476fa9be86774325d62d Jul 12 13:27:14.594824 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Project-Name: tempest-VolumesNegativeTest-1775942397 Jul 12 13:27:14.594824 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Role: reader,member Jul 12 13:27:14.594824 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Roles: reader,member Jul 12 13:27:14.596354 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d75bcce87627476fa9be86774325d62d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d75bcce87627476fa9be86774325d62d", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d75bcce87627476fa9be86774325d62d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d75bcce87627476fa9be86774325d62d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] Jul 12 13:27:14.596354 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Tenant: tempest-VolumesNegativeTest-1775942397 Jul 12 13:27:14.596354 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Tenant-Id: d75bcce87627476fa9be86774325d62d Jul 12 13:27:14.596354 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Tenant-Name: tempest-VolumesNegativeTest-1775942397 Jul 12 13:27:14.596354 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-User: tempest-VolumesNegativeTest-1775942397-project Jul 12 13:27:14.596354 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-User-Domain-Id: default Jul 12 13:27:14.596354 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-User-Domain-Name: Default Jul 12 13:27:14.596354 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-User-Id: 6161475cb848468e92eed1a657e2c835 Jul 12 13:27:14.596354 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-User-Name: tempest-VolumesNegativeTest-1775942397-project Jul 12 13:27:14.596354 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: method: Jul 12 13:27:14.596354 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: exception: Volume tempest-invalid-1911202847 could not be found. Jul 12 13:27:14.596354 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: action_args: {'id': 'tempest-invalid-1911202847'} Jul 12 13:27:14.596354 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 13:27:14.597308 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:27:14.597308 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 13:27:14.597308 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 13:27:14.597308 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 12 13:27:14.597308 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 12 13:27:14.597308 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 12 13:27:14.597308 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 12 13:27:14.597308 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 12 13:27:14.597308 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 12 13:27:14.597308 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 12 13:27:14.597308 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 12 13:27:14.597308 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 13:27:14.597308 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 13:27:14.597308 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 13:27:14.597308 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 13:27:14.597308 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1911202847 could not be found. (HTTP 404) (Request-ID: req-8208d86f-21cc-4108-a576-e014a215e9dd) Jul 12 13:27:14.597308 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi Jul 12 13:27:14.597308 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:27:14.597308 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi Jul 12 13:27:14.598743 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:27:14.598743 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 12 13:27:14.598743 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 12 13:27:14.598743 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 12 13:27:14.598743 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 12 13:27:14.598743 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 12 13:27:14.598743 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 12 13:27:14.598743 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 12 13:27:14.598743 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 12 13:27:14.598743 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 13:27:14.598743 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 13:27:14.598743 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 12 13:27:14.598743 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 12 13:27:14.598743 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 12 13:27:14.598743 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 12 13:27:14.598743 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 12 13:27:14.598743 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 12 13:27:14.598743 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 12 13:27:14.598743 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 12 13:27:14.600044 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 13:27:14.600044 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 13:27:14.600044 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 13:27:14.600044 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 13:27:14.600044 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1911202847 could not be found. Jul 12 13:27:14.600044 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi Jul 12 13:27:14.600044 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:27:14.600044 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi Jul 12 13:27:14.600044 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:27:14.600044 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:27:14.600044 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:27:14.600044 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 13:27:14.600044 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 13:27:14.600044 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 13:27:14.600044 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 13:27:14.600044 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 13:27:14.600044 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:27:14.600044 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 12 13:27:14.600044 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 13:27:14.600044 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1911202847 could not be found. Jul 12 13:27:14.602649 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi Jul 12 13:27:14.602649 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:27:14.602649 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi Jul 12 13:27:14.602649 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:27:14.602649 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:27:14.602649 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:27:14.602649 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 13:27:14.602649 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 13:27:14.602649 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1911202847 could not be found. Jul 12 13:27:14.602649 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi Jul 12 13:27:14.605362 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-67b2c129-35e2-4afa-af6e-0067cb03c6cc tempest-VolumesNegativeTest-1775942397 tempest-VolumesNegativeTest-1775942397-project] Returning 404 to user: Volume tempest-invalid-1911202847 could not be found. {{(pid=117988) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 13:27:14.606621 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-67b2c129-35e2-4afa-af6e-0067cb03c6cc tempest-VolumesNegativeTest-1775942397 tempest-VolumesNegativeTest-1775942397-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1911202847" status: 404 len: 99 microversion: 2.1 time: 0.893021 Jul 12 13:27:14.612511 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 2/4] 10.222.0.23 () {58 vars in 1217 bytes} [Tue Jul 12 13:27:13 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1911202847 => generated 99 bytes in 900 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 12 13:27:14.635266 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-2e0e1b81-da21-41a9-9ba6-856c4ad44266 tempest-VolumesNegativeTest-1775942397 tempest-VolumesNegativeTest-1775942397-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.018363 Jul 12 13:27:14.639642 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 3/5] 10.222.0.23 () {58 vars in 1139 bytes} [Tue Jul 12 13:27:14 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 23 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 12 13:27:14.653094 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-6fc3d944-4e60-449d-b64c-6c88dc0c6a06 tempest-VolumesNegativeTest-1775942397 tempest-VolumesNegativeTest-1775942397-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.011668 Jul 12 13:27:14.654721 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 3/6] 10.222.0.23 () {58 vars in 1136 bytes} [Tue Jul 12 13:27:14 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 14 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 12 13:27:14.682471 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-dc730219-e739-4341-b373-63385c7118ab tempest-VolumesNegativeTest-1775942397 tempest-VolumesNegativeTest-1775942397-project] Calling method '.version_select at 0x7f76eb991790>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:27:15.042593 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.wsgi [None req-dc730219-e739-4341-b373-63385c7118ab tempest-VolumesNegativeTest-1775942397 tempest-VolumesNegativeTest-1775942397-project] HTTP exception thrown: Volume dd010dd9-6e81-4736-8230-78fd28aacab6 could not be found. Jul 12 13:27:15.046362 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-dc730219-e739-4341-b373-63385c7118ab tempest-VolumesNegativeTest-1775942397 tempest-VolumesNegativeTest-1775942397-project] Request method failure captured: Jul 12 13:27:15.046362 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: request: DELETE /compute/v2.1/os-volumes/dd010dd9-6e81-4736-8230-78fd28aacab6 HTTP/1.1 Jul 12 13:27:15.046362 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: Accept: application/json Jul 12 13:27:15.046362 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: Accept-Encoding: identity Jul 12 13:27:15.046362 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: Connection: close Jul 12 13:27:15.046362 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: Content-Length: 0 Jul 12 13:27:15.046362 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: Content-Type: application/json Jul 12 13:27:15.046362 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: Host: 10.222.0.23 Jul 12 13:27:15.046362 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: Openstack-System-Scope: None Jul 12 13:27:15.046362 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: User-Agent: python-urllib3/1.26.9 Jul 12 13:27:15.046362 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Auth-Token: gAAAAABizXaupU6UCO4iP8ikK6p2ksEdCWlJUtBRYc7f3Z_sI8kq8hpYTET2_3y3VWcaYC5C4tJeUvQ3GgfPYQB-H5GoSPSFr58_O_tkbutDfknUFaLX-ovbLRu3Kxwjchk7ak2-TzODhEu52NLc_KW_w0udjIWbu8Wcg9-nVcAw5Jtz80Ik590 Jul 12 13:27:15.046362 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Domain-Id: None Jul 12 13:27:15.046362 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Domain-Name: None Jul 12 13:27:15.046362 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Identity-Status: Confirmed Jul 12 13:27:15.046362 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Is-Admin-Project: True Jul 12 13:27:15.046362 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Project-Domain-Id: default Jul 12 13:27:15.046362 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Project-Domain-Name: Default Jul 12 13:27:15.046362 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Project-Id: d75bcce87627476fa9be86774325d62d Jul 12 13:27:15.046362 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Project-Name: tempest-VolumesNegativeTest-1775942397 Jul 12 13:27:15.046362 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Role: reader,member Jul 12 13:27:15.046362 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Roles: reader,member Jul 12 13:27:15.047804 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d75bcce87627476fa9be86774325d62d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d75bcce87627476fa9be86774325d62d", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d75bcce87627476fa9be86774325d62d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d75bcce87627476fa9be86774325d62d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] Jul 12 13:27:15.047804 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Tenant: tempest-VolumesNegativeTest-1775942397 Jul 12 13:27:15.047804 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Tenant-Id: d75bcce87627476fa9be86774325d62d Jul 12 13:27:15.047804 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Tenant-Name: tempest-VolumesNegativeTest-1775942397 Jul 12 13:27:15.047804 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-User: tempest-VolumesNegativeTest-1775942397-project Jul 12 13:27:15.047804 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-User-Domain-Id: default Jul 12 13:27:15.047804 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-User-Domain-Name: Default Jul 12 13:27:15.047804 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-User-Id: 6161475cb848468e92eed1a657e2c835 Jul 12 13:27:15.047804 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-User-Name: tempest-VolumesNegativeTest-1775942397-project Jul 12 13:27:15.047804 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: method: Jul 12 13:27:15.047804 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: exception: Volume dd010dd9-6e81-4736-8230-78fd28aacab6 could not be found. Jul 12 13:27:15.047804 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: action_args: {'id': 'dd010dd9-6e81-4736-8230-78fd28aacab6'} Jul 12 13:27:15.047804 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 13:27:15.048617 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:27:15.048617 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 13:27:15.048617 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 13:27:15.048617 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 12 13:27:15.048617 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 12 13:27:15.048617 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 12 13:27:15.048617 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 12 13:27:15.048617 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 12 13:27:15.048617 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 12 13:27:15.048617 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 12 13:27:15.048617 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 12 13:27:15.048617 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 13:27:15.048617 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 13:27:15.048617 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 13:27:15.048617 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 13:27:15.048617 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume dd010dd9-6e81-4736-8230-78fd28aacab6 could not be found. (HTTP 404) (Request-ID: req-3bcbb0b1-48a1-4bcf-a6cc-f735028a541c) Jul 12 13:27:15.048617 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi Jul 12 13:27:15.048617 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:27:15.048617 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi Jul 12 13:27:15.050240 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:27:15.050240 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 12 13:27:15.050240 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 12 13:27:15.050240 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 12 13:27:15.050240 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 12 13:27:15.050240 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 12 13:27:15.050240 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 12 13:27:15.050240 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 12 13:27:15.050240 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 12 13:27:15.050240 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 13:27:15.050240 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 13:27:15.050240 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 12 13:27:15.050240 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 12 13:27:15.050240 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 12 13:27:15.050240 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 12 13:27:15.050240 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 12 13:27:15.050240 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 12 13:27:15.050240 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 12 13:27:15.050240 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 12 13:27:15.051627 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 13:27:15.051627 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 13:27:15.051627 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 13:27:15.051627 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 13:27:15.051627 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume dd010dd9-6e81-4736-8230-78fd28aacab6 could not be found. Jul 12 13:27:15.051627 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi Jul 12 13:27:15.051627 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:27:15.051627 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi Jul 12 13:27:15.051627 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:27:15.051627 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:27:15.051627 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:27:15.051627 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 13:27:15.051627 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 13:27:15.051627 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 13:27:15.051627 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 13:27:15.051627 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 13:27:15.051627 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:27:15.051627 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 12 13:27:15.051627 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 13:27:15.053043 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume dd010dd9-6e81-4736-8230-78fd28aacab6 could not be found. Jul 12 13:27:15.053043 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi Jul 12 13:27:15.053043 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:27:15.053043 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi Jul 12 13:27:15.053043 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:27:15.053043 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:27:15.053043 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:27:15.053043 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 13:27:15.053043 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 13:27:15.053043 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume dd010dd9-6e81-4736-8230-78fd28aacab6 could not be found. Jul 12 13:27:15.053043 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi Jul 12 13:27:15.053043 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-dc730219-e739-4341-b373-63385c7118ab tempest-VolumesNegativeTest-1775942397 tempest-VolumesNegativeTest-1775942397-project] Returning 404 to user: Volume dd010dd9-6e81-4736-8230-78fd28aacab6 could not be found. {{(pid=117987) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 13:27:15.053043 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-dc730219-e739-4341-b373-63385c7118ab tempest-VolumesNegativeTest-1775942397 tempest-VolumesNegativeTest-1775942397-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/dd010dd9-6e81-4736-8230-78fd28aacab6" status: 404 len: 109 microversion: 2.1 time: 0.387424 Jul 12 13:27:15.055340 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 4/7] 10.222.0.23 () {58 vars in 1247 bytes} [Tue Jul 12 13:27:14 2022] DELETE /compute/v2.1/os-volumes/dd010dd9-6e81-4736-8230-78fd28aacab6 => generated 109 bytes in 396 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 13:27:15.063394 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-acf31be1-2af2-49d8-a41a-741947060d0f tempest-VolumesNegativeTest-1775942397 tempest-VolumesNegativeTest-1775942397-project] Calling method '.version_select at 0x7f76eb82e940>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:27:15.269096 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.wsgi [None req-acf31be1-2af2-49d8-a41a-741947060d0f tempest-VolumesNegativeTest-1775942397 tempest-VolumesNegativeTest-1775942397-project] HTTP exception thrown: Volume 057f920f-8f6e-4b32-b0ba-ddb6f2614d10 could not be found. Jul 12 13:27:15.272966 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-acf31be1-2af2-49d8-a41a-741947060d0f tempest-VolumesNegativeTest-1775942397 tempest-VolumesNegativeTest-1775942397-project] Request method failure captured: Jul 12 13:27:15.272966 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: request: GET /compute/v2.1/os-volumes/057f920f-8f6e-4b32-b0ba-ddb6f2614d10 HTTP/1.1 Jul 12 13:27:15.272966 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: Accept: application/json Jul 12 13:27:15.272966 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: Accept-Encoding: identity Jul 12 13:27:15.272966 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: Connection: close Jul 12 13:27:15.272966 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: Content-Length: 0 Jul 12 13:27:15.272966 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: Content-Type: application/json Jul 12 13:27:15.272966 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: Host: 10.222.0.23 Jul 12 13:27:15.272966 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: Openstack-System-Scope: None Jul 12 13:27:15.272966 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: User-Agent: python-urllib3/1.26.9 Jul 12 13:27:15.272966 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Auth-Token: gAAAAABizXaupU6UCO4iP8ikK6p2ksEdCWlJUtBRYc7f3Z_sI8kq8hpYTET2_3y3VWcaYC5C4tJeUvQ3GgfPYQB-H5GoSPSFr58_O_tkbutDfknUFaLX-ovbLRu3Kxwjchk7ak2-TzODhEu52NLc_KW_w0udjIWbu8Wcg9-nVcAw5Jtz80Ik590 Jul 12 13:27:15.272966 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Domain-Id: None Jul 12 13:27:15.272966 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Domain-Name: None Jul 12 13:27:15.272966 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Identity-Status: Confirmed Jul 12 13:27:15.272966 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Is-Admin-Project: True Jul 12 13:27:15.272966 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Project-Domain-Id: default Jul 12 13:27:15.272966 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Project-Domain-Name: Default Jul 12 13:27:15.272966 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Project-Id: d75bcce87627476fa9be86774325d62d Jul 12 13:27:15.272966 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Project-Name: tempest-VolumesNegativeTest-1775942397 Jul 12 13:27:15.272966 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Role: reader,member Jul 12 13:27:15.272966 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Roles: reader,member Jul 12 13:27:15.274594 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d75bcce87627476fa9be86774325d62d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d75bcce87627476fa9be86774325d62d", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d75bcce87627476fa9be86774325d62d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d75bcce87627476fa9be86774325d62d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] Jul 12 13:27:15.274594 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Tenant: tempest-VolumesNegativeTest-1775942397 Jul 12 13:27:15.274594 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Tenant-Id: d75bcce87627476fa9be86774325d62d Jul 12 13:27:15.274594 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Tenant-Name: tempest-VolumesNegativeTest-1775942397 Jul 12 13:27:15.274594 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-User: tempest-VolumesNegativeTest-1775942397-project Jul 12 13:27:15.274594 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-User-Domain-Id: default Jul 12 13:27:15.274594 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-User-Domain-Name: Default Jul 12 13:27:15.274594 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-User-Id: 6161475cb848468e92eed1a657e2c835 Jul 12 13:27:15.274594 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-User-Name: tempest-VolumesNegativeTest-1775942397-project Jul 12 13:27:15.274594 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: method: Jul 12 13:27:15.274594 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: exception: Volume 057f920f-8f6e-4b32-b0ba-ddb6f2614d10 could not be found. Jul 12 13:27:15.274594 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: action_args: {'id': '057f920f-8f6e-4b32-b0ba-ddb6f2614d10'} Jul 12 13:27:15.274594 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 13:27:15.275501 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:27:15.275501 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 13:27:15.275501 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 13:27:15.275501 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 12 13:27:15.275501 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 12 13:27:15.275501 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 12 13:27:15.275501 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 12 13:27:15.275501 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 12 13:27:15.275501 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 12 13:27:15.275501 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 12 13:27:15.275501 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 12 13:27:15.275501 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 13:27:15.275501 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 13:27:15.275501 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 13:27:15.275501 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 13:27:15.275501 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 057f920f-8f6e-4b32-b0ba-ddb6f2614d10 could not be found. (HTTP 404) (Request-ID: req-dbe7e423-a411-4973-8edd-ffac8edd88c8) Jul 12 13:27:15.275501 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi Jul 12 13:27:15.275501 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:27:15.275501 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi Jul 12 13:27:15.276915 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:27:15.276915 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 12 13:27:15.276915 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 12 13:27:15.276915 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 12 13:27:15.276915 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 12 13:27:15.276915 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 12 13:27:15.276915 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 12 13:27:15.276915 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 12 13:27:15.276915 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 12 13:27:15.276915 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 13:27:15.276915 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 13:27:15.276915 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 12 13:27:15.276915 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 12 13:27:15.276915 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 12 13:27:15.276915 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 12 13:27:15.276915 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 12 13:27:15.276915 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 12 13:27:15.276915 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 12 13:27:15.276915 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 12 13:27:15.278142 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 13:27:15.278142 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 13:27:15.278142 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 13:27:15.278142 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 13:27:15.278142 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 057f920f-8f6e-4b32-b0ba-ddb6f2614d10 could not be found. Jul 12 13:27:15.278142 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi Jul 12 13:27:15.278142 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:27:15.278142 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi Jul 12 13:27:15.278142 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:27:15.278142 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:27:15.278142 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:27:15.278142 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 13:27:15.278142 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 13:27:15.278142 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 13:27:15.278142 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 13:27:15.278142 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 13:27:15.278142 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:27:15.278142 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 12 13:27:15.278142 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 13:27:15.279437 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 057f920f-8f6e-4b32-b0ba-ddb6f2614d10 could not be found. Jul 12 13:27:15.279437 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi Jul 12 13:27:15.279437 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:27:15.279437 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi Jul 12 13:27:15.279437 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:27:15.279437 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:27:15.279437 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:27:15.279437 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 13:27:15.279437 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 13:27:15.279437 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 057f920f-8f6e-4b32-b0ba-ddb6f2614d10 could not be found. Jul 12 13:27:15.279437 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi Jul 12 13:27:15.282341 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-acf31be1-2af2-49d8-a41a-741947060d0f tempest-VolumesNegativeTest-1775942397 tempest-VolumesNegativeTest-1775942397-project] Returning 404 to user: Volume 057f920f-8f6e-4b32-b0ba-ddb6f2614d10 could not be found. {{(pid=117988) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 13:27:15.284055 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-acf31be1-2af2-49d8-a41a-741947060d0f tempest-VolumesNegativeTest-1775942397 tempest-VolumesNegativeTest-1775942397-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/057f920f-8f6e-4b32-b0ba-ddb6f2614d10" status: 404 len: 109 microversion: 2.1 time: 0.226604 Jul 12 13:27:15.286044 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 4/8] 10.222.0.23 () {58 vars in 1244 bytes} [Tue Jul 12 13:27:15 2022] GET /compute/v2.1/os-volumes/057f920f-8f6e-4b32-b0ba-ddb6f2614d10 => generated 109 bytes in 230 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 12 13:27:22.886322 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-41807ff3-3dce-4d79-b03b-2091ae760ee9 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Action: 'create', calling method: .version_select at 0x7f76ec0b11f0>, body: {"keypair": {"name": "tempest-keypair-242911539", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKJsCCk27K0/G0+pjhH/jnV9Cae8ZohwH5Ib70/QflTkVnQgTfOs7rxuOjle2LvVq5e5NDe+sEyAASprGWH839PgHd6gBI/hkzmrf7jydS8hqX8XeNf3U3LBYVw1DDUQow=="}} {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:27:23.139135 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.quota [None req-41807ff3-3dce-4d79-b03b-2091ae760ee9 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Getting quotas for project 0a2414687e6d4a449e3aeec65921b3c4. Resources: {'key_pairs'} {{(pid=117987) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 13:27:23.195490 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.quota [None req-41807ff3-3dce-4d79-b03b-2091ae760ee9 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Getting quotas for user f8de4128718d4837af77d427973d30be and project 0a2414687e6d4a449e3aeec65921b3c4. Resources: {'key_pairs'} {{(pid=117987) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 13:27:23.346430 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-41807ff3-3dce-4d79-b03b-2091ae760ee9 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 1.349949 Jul 12 13:27:23.351464 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 5/9] 10.222.0.23 () {62 vars in 1199 bytes} [Tue Jul 12 13:27:21 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 1357 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Jul 12 13:27:29.246510 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-ac2e8042-a9fc-461d-a6f3-c518c134deb7 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1528840333", "imageRef": "ce5a4b61-4265-43de-a33e-a23a4c9f612d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2eeca288-aa45-4bd8-84bb-42469f011ae8"}], "security_groups": [{"name": "tempest-securitygroup--1461290288"}], "key_name": "tempest-keypair-242911539", "user_data": "}} {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:27:30.104517 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.network.neutron [None req-ac2e8042-a9fc-461d-a6f3-c518c134deb7 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] validate_networks() for [('2eeca288-aa45-4bd8-84bb-42469f011ae8', None, None, None, None, None)] {{(pid=117988) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 13:27:30.383949 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-25bfc073-1f62-4226-8798-9848712a5254 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Action: 'create', calling method: .version_select at 0x7f76eb7b5790>, body: {"keypair": {"name": "tempest-keypair-1219393667", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGo2Z1e3nBgDKtlGV/SHT1ItrnD72DpXFfwxocIS5Af21FCOrowEDBZgImIwDabXheJAcRxnFYkw9HRay35Ynre7RB+/wGtFKB33z2e2g3AJzjxbF7SqK5IpAsQqSZCCzg=="}} {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:27:30.428825 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.quota [None req-25bfc073-1f62-4226-8798-9848712a5254 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Getting quotas for project ab8fca4ab6ed466a864c5551fea5f7ff. Resources: {'key_pairs'} {{(pid=117987) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 13:27:30.443409 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.quota [None req-25bfc073-1f62-4226-8798-9848712a5254 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Getting quotas for user c4b710bbdf0c4d58b4f3ee7ef7410c0a and project ab8fca4ab6ed466a864c5551fea5f7ff. Resources: {'key_pairs'} {{(pid=117987) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 13:27:30.539041 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-25bfc073-1f62-4226-8798-9848712a5254 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.483653 Jul 12 13:27:30.545327 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 6/10] 10.222.0.23 () {60 vars in 1158 bytes} [Tue Jul 12 13:27:30 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:27:33.359347 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.virt.hardware [None req-ac2e8042-a9fc-461d-a6f3-c518c134deb7 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Flavor limits 0:0:0 {{(pid=117988) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 13:27:33.359991 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.virt.hardware [None req-ac2e8042-a9fc-461d-a6f3-c518c134deb7 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Image limits 0:0:0 {{(pid=117988) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 13:27:33.361953 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.virt.hardware [None req-ac2e8042-a9fc-461d-a6f3-c518c134deb7 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Flavor pref 0:0:0 {{(pid=117988) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 13:27:33.363053 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.virt.hardware [None req-ac2e8042-a9fc-461d-a6f3-c518c134deb7 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Image pref 0:0:0 {{(pid=117988) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 13:27:33.364505 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.virt.hardware [None req-ac2e8042-a9fc-461d-a6f3-c518c134deb7 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117988) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 13:27:33.418197 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-ac2e8042-a9fc-461d-a6f3-c518c134deb7 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:27:33.418850 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-ac2e8042-a9fc-461d-a6f3-c518c134deb7 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:27:33.420026 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-ac2e8042-a9fc-461d-a6f3-c518c134deb7 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:27:33.425260 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-ac2e8042-a9fc-461d-a6f3-c518c134deb7 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:27:33.521968 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.quota [None req-ac2e8042-a9fc-461d-a6f3-c518c134deb7 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Getting quotas for project 0a2414687e6d4a449e3aeec65921b3c4. Resources: {'ram', 'cores', 'instances'} {{(pid=117988) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 13:27:33.546639 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.quota [None req-ac2e8042-a9fc-461d-a6f3-c518c134deb7 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Getting quotas for user f8de4128718d4837af77d427973d30be and project 0a2414687e6d4a449e3aeec65921b3c4. Resources: {'ram', 'cores', 'instances'} {{(pid=117988) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 13:27:33.579746 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-ac2e8042-a9fc-461d-a6f3-c518c134deb7 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Going to run 1 instances... {{(pid=117988) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 13:27:33.590597 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-ac2e8042-a9fc-461d-a6f3-c518c134deb7 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 5d30ed54-909d-491f-a14c-bc4435cfdc6f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ce5a4b61-4265-43de-a33e-a23a4c9f612d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117988) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 13:27:33.909598 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-ac2e8042-a9fc-461d-a6f3-c518c134deb7 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 4.678533 Jul 12 13:27:33.915800 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 5/11] 10.222.0.23 () {62 vars in 1187 bytes} [Tue Jul 12 13:27:29 2022] POST /compute/v2.1/servers => generated 402 bytes in 4681 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 12 13:27:33.922039 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-bdcf762b-fca6-49ee-a5a6-54637c5160aa tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:27:33.922800 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-bdcf762b-fca6-49ee-a5a6-54637c5160aa tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 5d30ed54-909d-491f-a14c-bc4435cfdc6f] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:27:34.291163 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-bdcf762b-fca6-49ee-a5a6-54637c5160aa tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:27:34.329631 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-bdcf762b-fca6-49ee-a5a6-54637c5160aa tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:27:34.333989 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-bdcf762b-fca6-49ee-a5a6-54637c5160aa tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:27:34.339686 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-bdcf762b-fca6-49ee-a5a6-54637c5160aa tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f" status: 200 len: 1281 microversion: 2.20 time: 0.417575 Jul 12 13:27:34.342286 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 7/12] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:27:33 2022] GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f => generated 1281 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:27:35.367719 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-2d3e05f1-a697-4ebd-9015-d6a08911833b tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:27:35.368513 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-2d3e05f1-a697-4ebd-9015-d6a08911833b tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 5d30ed54-909d-491f-a14c-bc4435cfdc6f] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:27:35.642201 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-2d3e05f1-a697-4ebd-9015-d6a08911833b tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:27:35.684802 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-2d3e05f1-a697-4ebd-9015-d6a08911833b tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:27:35.697784 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-2d3e05f1-a697-4ebd-9015-d6a08911833b tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:27:35.699531 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-2d3e05f1-a697-4ebd-9015-d6a08911833b tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f" status: 200 len: 1281 microversion: 2.20 time: 0.336656 Jul 12 13:27:35.700531 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 6/13] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:27:35 2022] GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f => generated 1281 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:27:36.730699 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-41fcfaa9-2189-4c46-812f-9dba166c8d77 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:27:36.731307 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-41fcfaa9-2189-4c46-812f-9dba166c8d77 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 5d30ed54-909d-491f-a14c-bc4435cfdc6f] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:27:36.749147 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-41fcfaa9-2189-4c46-812f-9dba166c8d77 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:27:36.749633 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-41fcfaa9-2189-4c46-812f-9dba166c8d77 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:27:36.750413 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-41fcfaa9-2189-4c46-812f-9dba166c8d77 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:27:36.750847 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-41fcfaa9-2189-4c46-812f-9dba166c8d77 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:27:37.115447 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-552c65a5-56f1-4967-8fc0-66810111b524 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1805174393", "imageRef": "ce5a4b61-4265-43de-a33e-a23a4c9f612d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:27:37.273105 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-41fcfaa9-2189-4c46-812f-9dba166c8d77 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:27:37.289728 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.network.neutron [None req-552c65a5-56f1-4967-8fc0-66810111b524 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] validate_networks() for [('b989f9ce-12b7-439b-b182-1338e89fb49f', None, None, None, None, None)] {{(pid=117987) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 13:27:37.307631 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-41fcfaa9-2189-4c46-812f-9dba166c8d77 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:27:37.311391 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-41fcfaa9-2189-4c46-812f-9dba166c8d77 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:27:37.319063 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-41fcfaa9-2189-4c46-812f-9dba166c8d77 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f" status: 200 len: 1285 microversion: 2.20 time: 0.587618 Jul 12 13:27:37.324123 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 7/14] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:27:36 2022] GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f => generated 1285 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:27:37.337367 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-dc45b018-43b7-41a0-9d04-0f5c888ce309 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1116142690", "imageRef": "ce5a4b61-4265-43de-a33e-a23a4c9f612d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d6ab6b63-1bad-4bca-8802-8b8bd0c8df54"}], "security_groups": [{"name": "tempest-securitygroup--997786478"}], "key_name": "tempest-keypair-1219393667", "user_data": "}} {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:27:37.649873 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.network.neutron [None req-dc45b018-43b7-41a0-9d04-0f5c888ce309 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] validate_networks() for [('d6ab6b63-1bad-4bca-8802-8b8bd0c8df54', None, None, None, None, None)] {{(pid=117988) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 13:27:38.965658 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.virt.hardware [None req-dc45b018-43b7-41a0-9d04-0f5c888ce309 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Flavor limits 0:0:0 {{(pid=117988) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 13:27:38.966728 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.virt.hardware [None req-dc45b018-43b7-41a0-9d04-0f5c888ce309 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Image limits 0:0:0 {{(pid=117988) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 13:27:38.967471 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.virt.hardware [None req-dc45b018-43b7-41a0-9d04-0f5c888ce309 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Flavor pref 0:0:0 {{(pid=117988) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 13:27:38.968104 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.virt.hardware [None req-dc45b018-43b7-41a0-9d04-0f5c888ce309 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Image pref 0:0:0 {{(pid=117988) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 13:27:38.969445 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.virt.hardware [None req-dc45b018-43b7-41a0-9d04-0f5c888ce309 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117988) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 13:27:38.995763 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-dc45b018-43b7-41a0-9d04-0f5c888ce309 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:27:39.001069 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-dc45b018-43b7-41a0-9d04-0f5c888ce309 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:27:39.005644 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-dc45b018-43b7-41a0-9d04-0f5c888ce309 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:27:39.009684 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-dc45b018-43b7-41a0-9d04-0f5c888ce309 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:27:39.048375 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.quota [None req-dc45b018-43b7-41a0-9d04-0f5c888ce309 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Getting quotas for project ab8fca4ab6ed466a864c5551fea5f7ff. Resources: {'ram', 'cores', 'instances'} {{(pid=117988) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 13:27:39.055245 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.quota [None req-dc45b018-43b7-41a0-9d04-0f5c888ce309 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Getting quotas for user c4b710bbdf0c4d58b4f3ee7ef7410c0a and project ab8fca4ab6ed466a864c5551fea5f7ff. Resources: {'ram', 'cores', 'instances'} {{(pid=117988) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 13:27:39.076398 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-dc45b018-43b7-41a0-9d04-0f5c888ce309 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Going to run 1 instances... {{(pid=117988) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 13:27:39.080282 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-dc45b018-43b7-41a0-9d04-0f5c888ce309 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] [instance: eeb0b554-cd09-49b5-95f0-22fc7c707944] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ce5a4b61-4265-43de-a33e-a23a4c9f612d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117988) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 13:27:39.283955 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-dc45b018-43b7-41a0-9d04-0f5c888ce309 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.956966 Jul 12 13:27:39.286041 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 8/15] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 12 13:27:37 2022] POST /compute/v2.1/servers => generated 401 bytes in 1961 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 13:27:40.170396 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-cd9896d1-2037-46dd-b915-ff26758b9eb4 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1455104852", "imageRef": "ce5a4b61-4265-43de-a33e-a23a4c9f612d", "flavorRef": "452", "networks": [{"uuid": "23d7b72b-e10e-4acd-a9a9-a66e36d8ea26"}]}} {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:27:40.302627 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.network.neutron [None req-cd9896d1-2037-46dd-b915-ff26758b9eb4 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] validate_networks() for [('23d7b72b-e10e-4acd-a9a9-a66e36d8ea26', None, None, None, None, None)] {{(pid=117988) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 13:27:40.902433 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.virt.hardware [None req-552c65a5-56f1-4967-8fc0-66810111b524 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Flavor limits 0:0:0 {{(pid=117987) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 13:27:40.903031 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.virt.hardware [None req-552c65a5-56f1-4967-8fc0-66810111b524 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Image limits 0:0:0 {{(pid=117987) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 13:27:40.905050 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.virt.hardware [None req-552c65a5-56f1-4967-8fc0-66810111b524 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Flavor pref 0:0:0 {{(pid=117987) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 13:27:40.905514 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.virt.hardware [None req-552c65a5-56f1-4967-8fc0-66810111b524 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Image pref 0:0:0 {{(pid=117987) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 13:27:40.906162 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.virt.hardware [None req-552c65a5-56f1-4967-8fc0-66810111b524 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117987) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 13:27:40.936320 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-552c65a5-56f1-4967-8fc0-66810111b524 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:27:40.941069 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-552c65a5-56f1-4967-8fc0-66810111b524 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:27:40.947894 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-552c65a5-56f1-4967-8fc0-66810111b524 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:27:40.950257 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-552c65a5-56f1-4967-8fc0-66810111b524 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:27:41.088083 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.quota [None req-552c65a5-56f1-4967-8fc0-66810111b524 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Getting quotas for project 2c27fe465e6743e19feec424e6e9f3d1. Resources: {'ram', 'cores', 'instances'} {{(pid=117987) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 13:27:41.118692 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.quota [None req-552c65a5-56f1-4967-8fc0-66810111b524 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Getting quotas for user 8f448776d1074e22bfe6cfbe05e01db7 and project 2c27fe465e6743e19feec424e6e9f3d1. Resources: {'ram', 'cores', 'instances'} {{(pid=117987) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 13:27:41.222685 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-552c65a5-56f1-4967-8fc0-66810111b524 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Going to run 1 instances... {{(pid=117987) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 13:27:41.259598 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-552c65a5-56f1-4967-8fc0-66810111b524 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: bf8dbed9-b15d-4daf-af11-7ee001424482] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ce5a4b61-4265-43de-a33e-a23a4c9f612d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117987) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 13:27:41.514015 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-552c65a5-56f1-4967-8fc0-66810111b524 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 5.100740 Jul 12 13:27:41.522361 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 8/16] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 12 13:27:36 2022] POST /compute/v2.1/servers => generated 383 bytes in 5110 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 13:27:41.529039 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-807562ff-6953-4928-9059-2f481c2b47ee tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:27:41.529682 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-807562ff-6953-4928-9059-2f481c2b47ee tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 5d30ed54-909d-491f-a14c-bc4435cfdc6f] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:27:41.558392 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-807562ff-6953-4928-9059-2f481c2b47ee tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:27:41.558842 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-807562ff-6953-4928-9059-2f481c2b47ee tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:27:41.559610 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-807562ff-6953-4928-9059-2f481c2b47ee tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:27:41.571797 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-807562ff-6953-4928-9059-2f481c2b47ee tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:27:41.741462 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.virt.hardware [None req-cd9896d1-2037-46dd-b915-ff26758b9eb4 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Flavor limits 0:0:0 {{(pid=117988) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 13:27:41.741998 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.virt.hardware [None req-cd9896d1-2037-46dd-b915-ff26758b9eb4 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Image limits 0:0:0 {{(pid=117988) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 13:27:41.742442 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.virt.hardware [None req-cd9896d1-2037-46dd-b915-ff26758b9eb4 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Flavor pref 0:0:0 {{(pid=117988) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 13:27:41.742866 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.virt.hardware [None req-cd9896d1-2037-46dd-b915-ff26758b9eb4 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Image pref 0:0:0 {{(pid=117988) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 13:27:41.743281 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.virt.hardware [None req-cd9896d1-2037-46dd-b915-ff26758b9eb4 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117988) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 13:27:41.786642 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-cd9896d1-2037-46dd-b915-ff26758b9eb4 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:27:41.788930 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-cd9896d1-2037-46dd-b915-ff26758b9eb4 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:27:41.790137 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-cd9896d1-2037-46dd-b915-ff26758b9eb4 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:27:41.793262 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-cd9896d1-2037-46dd-b915-ff26758b9eb4 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:27:41.868151 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.quota [None req-cd9896d1-2037-46dd-b915-ff26758b9eb4 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Getting quotas for project d44719e63bb947bdb13e9309d1576521. Resources: {'ram', 'cores', 'instances'} {{(pid=117988) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 13:27:41.885643 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.quota [None req-cd9896d1-2037-46dd-b915-ff26758b9eb4 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Getting quotas for user 83bbc8ad40b44661b526511ecbc51027 and project d44719e63bb947bdb13e9309d1576521. Resources: {'ram', 'cores', 'instances'} {{(pid=117988) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 13:27:41.957850 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-cd9896d1-2037-46dd-b915-ff26758b9eb4 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Going to run 1 instances... {{(pid=117988) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 13:27:41.964911 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-cd9896d1-2037-46dd-b915-ff26758b9eb4 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] [instance: fa6eab49-6809-41fa-96c5-a6297dbe51d6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ce5a4b61-4265-43de-a33e-a23a4c9f612d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117988) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 13:27:42.109086 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-cd9896d1-2037-46dd-b915-ff26758b9eb4 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.818745 Jul 12 13:27:42.113657 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 9/17] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 12 13:27:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 2826 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 13:27:42.133123 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-e9625b0a-2f1e-480c-b5f8-46b486fbaff4 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:27:42.133778 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-e9625b0a-2f1e-480c-b5f8-46b486fbaff4 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] [instance: eeb0b554-cd09-49b5-95f0-22fc7c707944] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:27:42.168829 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-e9625b0a-2f1e-480c-b5f8-46b486fbaff4 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:27:42.169709 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-e9625b0a-2f1e-480c-b5f8-46b486fbaff4 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:27:42.173290 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-e9625b0a-2f1e-480c-b5f8-46b486fbaff4 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:27:42.176923 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-e9625b0a-2f1e-480c-b5f8-46b486fbaff4 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:27:42.442524 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-807562ff-6953-4928-9059-2f481c2b47ee tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:27:42.503236 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-807562ff-6953-4928-9059-2f481c2b47ee tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:27:42.510726 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-807562ff-6953-4928-9059-2f481c2b47ee tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:27:42.512638 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-807562ff-6953-4928-9059-2f481c2b47ee tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f" status: 200 len: 1407 microversion: 2.20 time: 0.987889 Jul 12 13:27:42.514136 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 9/18] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:27:41 2022] GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f => generated 1407 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:27:42.521656 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-bf0fadab-1a23-45ee-92ad-af4ddde1d432 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:27:42.522541 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-bf0fadab-1a23-45ee-92ad-af4ddde1d432 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: bf8dbed9-b15d-4daf-af11-7ee001424482] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:27:42.543941 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-e9625b0a-2f1e-480c-b5f8-46b486fbaff4 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b710bbdf0c4d58b4f3ee7ef7410c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8fca4ab6ed466a864c5551fea5f7ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:27:42.597822 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-e9625b0a-2f1e-480c-b5f8-46b486fbaff4 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] 10.222.0.23 "GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944" status: 200 len: 1242 microversion: 2.1 time: 0.475365 Jul 12 13:27:42.601740 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 10/19] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:27:42 2022] GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944 => generated 1242 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:27:42.608196 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-b6b1229f-415d-4761-9936-cbcb306be688 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:27:42.609404 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-b6b1229f-415d-4761-9936-cbcb306be688 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] [instance: fa6eab49-6809-41fa-96c5-a6297dbe51d6] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:27:42.744591 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-bf0fadab-1a23-45ee-92ad-af4ddde1d432 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f448776d1074e22bfe6cfbe05e01db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27fe465e6743e19feec424e6e9f3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:27:42.752843 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-bf0fadab-1a23-45ee-92ad-af4ddde1d432 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "GET /compute/v2.1/servers/bf8dbed9-b15d-4daf-af11-7ee001424482" status: 200 len: 1222 microversion: 2.1 time: 0.236395 Jul 12 13:27:42.766803 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 10/20] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:27:42 2022] GET /compute/v2.1/servers/bf8dbed9-b15d-4daf-af11-7ee001424482 => generated 1222 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:27:42.865680 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-b6b1229f-415d-4761-9936-cbcb306be688 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbc8ad40b44661b526511ecbc51027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd44719e63bb947bdb13e9309d1576521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:27:42.875480 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-b6b1229f-415d-4761-9936-cbcb306be688 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] 10.222.0.23 "GET /compute/v2.1/servers/fa6eab49-6809-41fa-96c5-a6297dbe51d6" status: 200 len: 1215 microversion: 2.1 time: 0.272297 Jul 12 13:27:42.880631 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 11/21] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:27:42 2022] GET /compute/v2.1/servers/fa6eab49-6809-41fa-96c5-a6297dbe51d6 => generated 1215 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:27:43.086949 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-1cc302c4-ab97-4d08-88ca-1197f52e47a7 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-625300037", "imageRef": "ce5a4b61-4265-43de-a33e-a23a4c9f612d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:27:43.255565 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.network.neutron [None req-1cc302c4-ab97-4d08-88ca-1197f52e47a7 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] validate_networks() for [('b989f9ce-12b7-439b-b182-1338e89fb49f', None, None, None, None, None)] {{(pid=117987) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 13:27:43.533668 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-84288c7e-b85a-4869-994d-eda26e0605e2 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:27:43.535528 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-84288c7e-b85a-4869-994d-eda26e0605e2 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 5d30ed54-909d-491f-a14c-bc4435cfdc6f] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:27:43.551381 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-84288c7e-b85a-4869-994d-eda26e0605e2 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:27:43.555106 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-84288c7e-b85a-4869-994d-eda26e0605e2 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:27:43.557188 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-84288c7e-b85a-4869-994d-eda26e0605e2 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:27:43.560707 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-84288c7e-b85a-4869-994d-eda26e0605e2 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:27:44.508568 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.virt.hardware [None req-1cc302c4-ab97-4d08-88ca-1197f52e47a7 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Flavor limits 0:0:0 {{(pid=117987) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 13:27:44.509897 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.virt.hardware [None req-1cc302c4-ab97-4d08-88ca-1197f52e47a7 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Image limits 0:0:0 {{(pid=117987) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 13:27:44.509897 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.virt.hardware [None req-1cc302c4-ab97-4d08-88ca-1197f52e47a7 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Flavor pref 0:0:0 {{(pid=117987) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 13:27:44.510294 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.virt.hardware [None req-1cc302c4-ab97-4d08-88ca-1197f52e47a7 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Image pref 0:0:0 {{(pid=117987) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 13:27:44.510523 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.virt.hardware [None req-1cc302c4-ab97-4d08-88ca-1197f52e47a7 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117987) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 13:27:44.545160 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-1cc302c4-ab97-4d08-88ca-1197f52e47a7 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:27:44.545749 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-1cc302c4-ab97-4d08-88ca-1197f52e47a7 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:27:44.546656 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-1cc302c4-ab97-4d08-88ca-1197f52e47a7 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:27:44.551970 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-1cc302c4-ab97-4d08-88ca-1197f52e47a7 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:27:44.630901 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.quota [None req-1cc302c4-ab97-4d08-88ca-1197f52e47a7 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Getting quotas for project 2c27fe465e6743e19feec424e6e9f3d1. Resources: {'ram', 'cores', 'instances'} {{(pid=117987) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 13:27:44.641671 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.quota [None req-1cc302c4-ab97-4d08-88ca-1197f52e47a7 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Getting quotas for user 8f448776d1074e22bfe6cfbe05e01db7 and project 2c27fe465e6743e19feec424e6e9f3d1. Resources: {'ram', 'cores', 'instances'} {{(pid=117987) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 13:27:44.699673 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-1cc302c4-ab97-4d08-88ca-1197f52e47a7 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Going to run 1 instances... {{(pid=117987) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 13:27:44.703716 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-1cc302c4-ab97-4d08-88ca-1197f52e47a7 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: 95edada5-d3ec-4056-99e9-379fb4b65394] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ce5a4b61-4265-43de-a33e-a23a4c9f612d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117987) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 13:27:44.823656 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-84288c7e-b85a-4869-994d-eda26e0605e2 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:27:44.827373 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-1cc302c4-ab97-4d08-88ca-1197f52e47a7 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.745208 Jul 12 13:27:44.835847 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 11/22] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 12 13:27:43 2022] POST /compute/v2.1/servers => generated 383 bytes in 1754 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 13:27:44.842971 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-9a9195f7-7bfd-433f-98e6-e68f45353fce tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:27:44.844401 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-9a9195f7-7bfd-433f-98e6-e68f45353fce tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] [instance: eeb0b554-cd09-49b5-95f0-22fc7c707944] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:27:44.857170 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-84288c7e-b85a-4869-994d-eda26e0605e2 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:27:44.860080 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-9a9195f7-7bfd-433f-98e6-e68f45353fce tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:27:44.860539 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-9a9195f7-7bfd-433f-98e6-e68f45353fce tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:27:44.861762 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-9a9195f7-7bfd-433f-98e6-e68f45353fce tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:27:44.862202 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-9a9195f7-7bfd-433f-98e6-e68f45353fce tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:27:44.871312 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-84288c7e-b85a-4869-994d-eda26e0605e2 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:27:44.872507 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-84288c7e-b85a-4869-994d-eda26e0605e2 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f" status: 200 len: 1407 microversion: 2.20 time: 1.344454 Jul 12 13:27:44.875613 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 12/23] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:27:43 2022] GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f => generated 1407 bytes in 1348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 13:27:44.904027 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-891028bf-221f-4515-9038-2afe4431ed24 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:27:44.904665 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-891028bf-221f-4515-9038-2afe4431ed24 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] [instance: fa6eab49-6809-41fa-96c5-a6297dbe51d6] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:27:44.949156 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-891028bf-221f-4515-9038-2afe4431ed24 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:27:44.949683 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-891028bf-221f-4515-9038-2afe4431ed24 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:27:44.972947 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-891028bf-221f-4515-9038-2afe4431ed24 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:27:44.976873 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-891028bf-221f-4515-9038-2afe4431ed24 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:27:45.081682 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-9a9195f7-7bfd-433f-98e6-e68f45353fce tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b710bbdf0c4d58b4f3ee7ef7410c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8fca4ab6ed466a864c5551fea5f7ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:27:45.098293 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-9a9195f7-7bfd-433f-98e6-e68f45353fce tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] 10.222.0.23 "GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944" status: 200 len: 1290 microversion: 2.1 time: 0.258241 Jul 12 13:27:45.099267 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 12/24] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:27:44 2022] GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944 => generated 1290 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:27:45.123802 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-97edec32-dacd-4812-a23a-bb7ad7209e0a tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:27:45.125398 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-97edec32-dacd-4812-a23a-bb7ad7209e0a tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: 95edada5-d3ec-4056-99e9-379fb4b65394] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:27:45.519505 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-891028bf-221f-4515-9038-2afe4431ed24 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbc8ad40b44661b526511ecbc51027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd44719e63bb947bdb13e9309d1576521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:27:45.538425 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-891028bf-221f-4515-9038-2afe4431ed24 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] 10.222.0.23 "GET /compute/v2.1/servers/fa6eab49-6809-41fa-96c5-a6297dbe51d6" status: 200 len: 1211 microversion: 2.1 time: 0.661636 Jul 12 13:27:45.541855 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-97edec32-dacd-4812-a23a-bb7ad7209e0a tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f448776d1074e22bfe6cfbe05e01db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27fe465e6743e19feec424e6e9f3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:27:45.543632 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 13/25] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:27:44 2022] GET /compute/v2.1/servers/fa6eab49-6809-41fa-96c5-a6297dbe51d6 => generated 1211 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:27:45.603637 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-97edec32-dacd-4812-a23a-bb7ad7209e0a tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394" status: 200 len: 1221 microversion: 2.1 time: 0.492793 Jul 12 13:27:45.604973 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 13/26] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:27:45 2022] GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394 => generated 1221 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:27:45.903957 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-e235f633-76ff-4ad9-952f-984313559dd9 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:27:45.904942 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-e235f633-76ff-4ad9-952f-984313559dd9 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 5d30ed54-909d-491f-a14c-bc4435cfdc6f] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:27:45.935604 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-e235f633-76ff-4ad9-952f-984313559dd9 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:27:45.936198 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-e235f633-76ff-4ad9-952f-984313559dd9 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:27:45.941094 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-e235f633-76ff-4ad9-952f-984313559dd9 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:27:45.941578 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-e235f633-76ff-4ad9-952f-984313559dd9 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:27:46.116974 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-b25ee8a3-a41e-4866-86d3-5a39f08d7813 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:27:46.117504 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-b25ee8a3-a41e-4866-86d3-5a39f08d7813 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] [instance: eeb0b554-cd09-49b5-95f0-22fc7c707944] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:27:46.129330 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-b25ee8a3-a41e-4866-86d3-5a39f08d7813 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:27:46.129808 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-b25ee8a3-a41e-4866-86d3-5a39f08d7813 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:27:46.130704 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-b25ee8a3-a41e-4866-86d3-5a39f08d7813 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:27:46.131148 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-b25ee8a3-a41e-4866-86d3-5a39f08d7813 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:27:46.553223 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-b25ee8a3-a41e-4866-86d3-5a39f08d7813 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b710bbdf0c4d58b4f3ee7ef7410c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8fca4ab6ed466a864c5551fea5f7ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:27:46.567811 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-b25ee8a3-a41e-4866-86d3-5a39f08d7813 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] 10.222.0.23 "GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944" status: 200 len: 1308 microversion: 2.1 time: 0.454559 Jul 12 13:27:46.568647 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 14/27] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:27:46 2022] GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944 => generated 1308 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:27:46.586677 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-20729a8e-28e4-4e2d-ad9f-008fbb76d68c tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:27:46.587950 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-20729a8e-28e4-4e2d-ad9f-008fbb76d68c tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] [instance: fa6eab49-6809-41fa-96c5-a6297dbe51d6] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:27:46.618832 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-20729a8e-28e4-4e2d-ad9f-008fbb76d68c tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:27:46.621951 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-20729a8e-28e4-4e2d-ad9f-008fbb76d68c tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:27:46.625043 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-20729a8e-28e4-4e2d-ad9f-008fbb76d68c tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:27:46.625620 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-20729a8e-28e4-4e2d-ad9f-008fbb76d68c tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:27:46.749246 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-e235f633-76ff-4ad9-952f-984313559dd9 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:27:46.765546 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-e235f633-76ff-4ad9-952f-984313559dd9 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:27:46.769802 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-e235f633-76ff-4ad9-952f-984313559dd9 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:27:46.771235 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-e235f633-76ff-4ad9-952f-984313559dd9 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f" status: 200 len: 1407 microversion: 2.20 time: 0.882663 Jul 12 13:27:46.793153 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 14/28] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:27:45 2022] GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f => generated 1407 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:27:46.801316 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-cd60737c-743d-410f-9fa4-2ad4b72f889e tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:27:46.802659 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-cd60737c-743d-410f-9fa4-2ad4b72f889e tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: 95edada5-d3ec-4056-99e9-379fb4b65394] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:27:46.809496 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-cd60737c-743d-410f-9fa4-2ad4b72f889e tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:27:46.810258 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-cd60737c-743d-410f-9fa4-2ad4b72f889e tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:27:46.811221 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-cd60737c-743d-410f-9fa4-2ad4b72f889e tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:27:46.811811 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-cd60737c-743d-410f-9fa4-2ad4b72f889e tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:27:46.877061 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-20729a8e-28e4-4e2d-ad9f-008fbb76d68c tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbc8ad40b44661b526511ecbc51027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd44719e63bb947bdb13e9309d1576521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:27:46.888156 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-20729a8e-28e4-4e2d-ad9f-008fbb76d68c tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] 10.222.0.23 "GET /compute/v2.1/servers/fa6eab49-6809-41fa-96c5-a6297dbe51d6" status: 200 len: 1267 microversion: 2.1 time: 0.318262 Jul 12 13:27:46.898661 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 15/29] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:27:46 2022] GET /compute/v2.1/servers/fa6eab49-6809-41fa-96c5-a6297dbe51d6 => generated 1267 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:27:47.060730 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-cd60737c-743d-410f-9fa4-2ad4b72f889e tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f448776d1074e22bfe6cfbe05e01db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27fe465e6743e19feec424e6e9f3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:27:47.098962 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-cd60737c-743d-410f-9fa4-2ad4b72f889e tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394" status: 200 len: 1225 microversion: 2.1 time: 0.294900 Jul 12 13:27:47.100366 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 15/30] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:27:46 2022] GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394 => generated 1225 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:27:47.589437 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-180c53ed-96dd-497b-8e26-5ca7a39ee0b7 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:27:47.590894 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-180c53ed-96dd-497b-8e26-5ca7a39ee0b7 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] [instance: eeb0b554-cd09-49b5-95f0-22fc7c707944] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:27:47.597811 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-180c53ed-96dd-497b-8e26-5ca7a39ee0b7 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:27:47.598774 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-180c53ed-96dd-497b-8e26-5ca7a39ee0b7 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:27:47.600267 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-180c53ed-96dd-497b-8e26-5ca7a39ee0b7 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:27:47.602088 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-180c53ed-96dd-497b-8e26-5ca7a39ee0b7 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:27:47.692302 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-180c53ed-96dd-497b-8e26-5ca7a39ee0b7 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b710bbdf0c4d58b4f3ee7ef7410c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8fca4ab6ed466a864c5551fea5f7ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:27:47.712542 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-180c53ed-96dd-497b-8e26-5ca7a39ee0b7 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] 10.222.0.23 "GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944" status: 200 len: 1308 microversion: 2.1 time: 0.126396 Jul 12 13:27:47.714355 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 16/31] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:27:47 2022] GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944 => generated 1308 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:27:47.799387 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-8d9a514e-5392-4518-a854-2376da84534a tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:27:47.800156 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-8d9a514e-5392-4518-a854-2376da84534a tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 5d30ed54-909d-491f-a14c-bc4435cfdc6f] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:27:47.810117 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-8d9a514e-5392-4518-a854-2376da84534a tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:27:47.813073 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-8d9a514e-5392-4518-a854-2376da84534a tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:27:47.816177 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-8d9a514e-5392-4518-a854-2376da84534a tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:27:47.816884 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-8d9a514e-5392-4518-a854-2376da84534a tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:27:48.005461 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [req-61746894-4976-4458-a2aa-21b257ab5956 req-9108d9e5-d0fd-41b7-83a0-7cd7b4562726 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d30ed54-909d-491f-a14c-bc4435cfdc6f", "tag": "f13aa237-fefb-4e93-8923-7007031116c1"}]} {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:27:48.030843 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [req-61746894-4976-4458-a2aa-21b257ab5956 req-9108d9e5-d0fd-41b7-83a0-7cd7b4562726 service nova] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:27:48.032054 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [req-61746894-4976-4458-a2aa-21b257ab5956 req-9108d9e5-d0fd-41b7-83a0-7cd7b4562726 service nova] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:27:48.074031 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.compute.server_external_events [req-61746894-4976-4458-a2aa-21b257ab5956 req-9108d9e5-d0fd-41b7-83a0-7cd7b4562726 service nova] Creating event network-changed:f13aa237-fefb-4e93-8923-7007031116c1 for instance 5d30ed54-909d-491f-a14c-bc4435cfdc6f on hv-cinder-82002 Jul 12 13:27:48.074484 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [req-61746894-4976-4458-a2aa-21b257ab5956 req-9108d9e5-d0fd-41b7-83a0-7cd7b4562726 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117987) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 12 13:27:48.075589 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-ea98d54b-a667-4e24-a368-604133b83adb None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:27:48.076024 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-ea98d54b-a667-4e24-a368-604133b83adb None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:27:48.076866 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-ea98d54b-a667-4e24-a368-604133b83adb None None] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:27:48.077307 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-ea98d54b-a667-4e24-a368-604133b83adb None None] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:27:48.088394 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.compute.rpcapi [None req-ea98d54b-a667-4e24-a368-604133b83adb None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 12 13:27:48.089481 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-ea98d54b-a667-4e24-a368-604133b83adb None None] Releasing lock "compute-rpcapi-router" {{(pid=117987) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 12 13:27:48.140979 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-8d9a514e-5392-4518-a854-2376da84534a tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:27:48.156636 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-8d9a514e-5392-4518-a854-2376da84534a tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:27:48.162278 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-ea98d54b-a667-4e24-a368-604133b83adb None None] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.251544 Jul 12 13:27:48.162928 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 17/32] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 12 13:27:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:27:48.165037 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-8d9a514e-5392-4518-a854-2376da84534a tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:27:48.166590 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-8d9a514e-5392-4518-a854-2376da84534a tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f" status: 200 len: 1407 microversion: 2.20 time: 0.372252 Jul 12 13:27:48.167305 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 16/33] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:27:47 2022] GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f => generated 1407 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:27:48.172094 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-d7e7ea27-929c-4936-b303-15c1e15d69ff tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:27:48.172699 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-d7e7ea27-929c-4936-b303-15c1e15d69ff tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] [instance: fa6eab49-6809-41fa-96c5-a6297dbe51d6] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:27:48.185462 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-d7e7ea27-929c-4936-b303-15c1e15d69ff tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:27:48.185932 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-d7e7ea27-929c-4936-b303-15c1e15d69ff tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:27:48.186101 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-16e8db57-db3d-4a13-94ea-ef26c66ce964 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:27:48.186873 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-16e8db57-db3d-4a13-94ea-ef26c66ce964 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: 95edada5-d3ec-4056-99e9-379fb4b65394] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:27:48.187506 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-d7e7ea27-929c-4936-b303-15c1e15d69ff tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:27:48.188128 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-d7e7ea27-929c-4936-b303-15c1e15d69ff tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:27:48.213401 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-16e8db57-db3d-4a13-94ea-ef26c66ce964 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:27:48.214225 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-16e8db57-db3d-4a13-94ea-ef26c66ce964 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:27:48.214995 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-16e8db57-db3d-4a13-94ea-ef26c66ce964 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:27:48.216208 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-16e8db57-db3d-4a13-94ea-ef26c66ce964 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:27:48.353578 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-d7e7ea27-929c-4936-b303-15c1e15d69ff tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbc8ad40b44661b526511ecbc51027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd44719e63bb947bdb13e9309d1576521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:27:48.366028 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-d7e7ea27-929c-4936-b303-15c1e15d69ff tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] 10.222.0.23 "GET /compute/v2.1/servers/fa6eab49-6809-41fa-96c5-a6297dbe51d6" status: 200 len: 1267 microversion: 2.1 time: 0.197428 Jul 12 13:27:48.368479 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 17/34] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:27:48 2022] GET /compute/v2.1/servers/fa6eab49-6809-41fa-96c5-a6297dbe51d6 => generated 1267 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:27:48.380922 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-16e8db57-db3d-4a13-94ea-ef26c66ce964 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f448776d1074e22bfe6cfbe05e01db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27fe465e6743e19feec424e6e9f3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:27:48.392666 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-16e8db57-db3d-4a13-94ea-ef26c66ce964 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394" status: 200 len: 1225 microversion: 2.1 time: 0.209167 Jul 12 13:27:48.394060 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 18/35] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:27:48 2022] GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394 => generated 1225 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:27:48.750443 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-0f127127-ba76-471c-a82f-335603d42c8d tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:27:48.754347 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-0f127127-ba76-471c-a82f-335603d42c8d tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] [instance: eeb0b554-cd09-49b5-95f0-22fc7c707944] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:27:48.770251 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-0f127127-ba76-471c-a82f-335603d42c8d tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:27:48.777957 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-0f127127-ba76-471c-a82f-335603d42c8d tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:27:48.780912 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-0f127127-ba76-471c-a82f-335603d42c8d tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:27:48.781757 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-0f127127-ba76-471c-a82f-335603d42c8d tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:27:48.855003 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-0f127127-ba76-471c-a82f-335603d42c8d tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b710bbdf0c4d58b4f3ee7ef7410c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8fca4ab6ed466a864c5551fea5f7ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:27:48.864521 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-0f127127-ba76-471c-a82f-335603d42c8d tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] 10.222.0.23 "GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944" status: 200 len: 1308 microversion: 2.1 time: 0.130829 Jul 12 13:27:48.865356 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 18/36] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:27:48 2022] GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944 => generated 1308 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:27:49.184655 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-757dfc5a-b8b0-48a2-8c81-127bebde3d09 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:27:49.185273 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-757dfc5a-b8b0-48a2-8c81-127bebde3d09 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 5d30ed54-909d-491f-a14c-bc4435cfdc6f] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:27:49.202141 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-757dfc5a-b8b0-48a2-8c81-127bebde3d09 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:27:49.202749 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-757dfc5a-b8b0-48a2-8c81-127bebde3d09 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:27:49.208333 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-757dfc5a-b8b0-48a2-8c81-127bebde3d09 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:27:49.210553 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-757dfc5a-b8b0-48a2-8c81-127bebde3d09 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:27:49.387990 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-15245f4b-67ae-45dc-99cd-3d23c96edd31 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:27:49.388640 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-15245f4b-67ae-45dc-99cd-3d23c96edd31 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] [instance: fa6eab49-6809-41fa-96c5-a6297dbe51d6] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:27:49.401563 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-757dfc5a-b8b0-48a2-8c81-127bebde3d09 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:27:49.404156 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-15245f4b-67ae-45dc-99cd-3d23c96edd31 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:27:49.404840 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-15245f4b-67ae-45dc-99cd-3d23c96edd31 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:27:49.406253 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-15245f4b-67ae-45dc-99cd-3d23c96edd31 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:27:49.406987 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-15245f4b-67ae-45dc-99cd-3d23c96edd31 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:27:49.412300 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-757dfc5a-b8b0-48a2-8c81-127bebde3d09 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:27:49.413978 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-757dfc5a-b8b0-48a2-8c81-127bebde3d09 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:27:49.415592 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-757dfc5a-b8b0-48a2-8c81-127bebde3d09 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f" status: 200 len: 1407 microversion: 2.20 time: 0.234669 Jul 12 13:27:49.416316 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 19/37] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:27:49 2022] GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f => generated 1407 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:27:49.425050 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-0230fded-a8a1-493d-8604-c717c1edae1b tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:27:49.425820 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-0230fded-a8a1-493d-8604-c717c1edae1b tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: 95edada5-d3ec-4056-99e9-379fb4b65394] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:27:49.435987 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-0230fded-a8a1-493d-8604-c717c1edae1b tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:27:49.436790 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-0230fded-a8a1-493d-8604-c717c1edae1b tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:27:49.438169 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-0230fded-a8a1-493d-8604-c717c1edae1b tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:27:49.438666 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-0230fded-a8a1-493d-8604-c717c1edae1b tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:27:49.598378 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-15245f4b-67ae-45dc-99cd-3d23c96edd31 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbc8ad40b44661b526511ecbc51027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd44719e63bb947bdb13e9309d1576521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:27:49.603168 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-0230fded-a8a1-493d-8604-c717c1edae1b tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f448776d1074e22bfe6cfbe05e01db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27fe465e6743e19feec424e6e9f3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:27:49.607439 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-15245f4b-67ae-45dc-99cd-3d23c96edd31 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] 10.222.0.23 "GET /compute/v2.1/servers/fa6eab49-6809-41fa-96c5-a6297dbe51d6" status: 200 len: 1267 microversion: 2.1 time: 0.226909 Jul 12 13:27:49.608849 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 19/38] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:27:49 2022] GET /compute/v2.1/servers/fa6eab49-6809-41fa-96c5-a6297dbe51d6 => generated 1267 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:27:49.622536 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-0230fded-a8a1-493d-8604-c717c1edae1b tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394" status: 200 len: 1225 microversion: 2.1 time: 0.204894 Jul 12 13:27:49.634462 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 20/39] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:27:49 2022] GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394 => generated 1225 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:27:49.882271 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-a11df4ee-7271-4780-ade8-b3eb11cd297e tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:27:49.883247 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-a11df4ee-7271-4780-ade8-b3eb11cd297e tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] [instance: eeb0b554-cd09-49b5-95f0-22fc7c707944] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:27:49.890419 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-a11df4ee-7271-4780-ade8-b3eb11cd297e tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:27:49.892518 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-a11df4ee-7271-4780-ade8-b3eb11cd297e tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:27:49.893747 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-a11df4ee-7271-4780-ade8-b3eb11cd297e tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:27:49.894199 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-a11df4ee-7271-4780-ade8-b3eb11cd297e tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:27:49.996938 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-a11df4ee-7271-4780-ade8-b3eb11cd297e tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b710bbdf0c4d58b4f3ee7ef7410c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8fca4ab6ed466a864c5551fea5f7ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:27:50.008184 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-a11df4ee-7271-4780-ade8-b3eb11cd297e tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] 10.222.0.23 "GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944" status: 200 len: 1308 microversion: 2.1 time: 0.129831 Jul 12 13:27:50.008901 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 20/40] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:27:49 2022] GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944 => generated 1308 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:27:50.441314 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-6ca08a9b-c7e2-4d2f-8a1b-91e26365c512 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:27:50.441983 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-6ca08a9b-c7e2-4d2f-8a1b-91e26365c512 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 5d30ed54-909d-491f-a14c-bc4435cfdc6f] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:27:50.452179 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-6ca08a9b-c7e2-4d2f-8a1b-91e26365c512 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:27:50.453102 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-6ca08a9b-c7e2-4d2f-8a1b-91e26365c512 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:27:50.454434 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-6ca08a9b-c7e2-4d2f-8a1b-91e26365c512 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:27:50.456610 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-6ca08a9b-c7e2-4d2f-8a1b-91e26365c512 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:27:50.614616 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-6ca08a9b-c7e2-4d2f-8a1b-91e26365c512 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:27:50.625841 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-524f83bc-3f46-4a21-8a5f-74cd7b35d3fc tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:27:50.628000 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-524f83bc-3f46-4a21-8a5f-74cd7b35d3fc tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] [instance: fa6eab49-6809-41fa-96c5-a6297dbe51d6] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:27:50.634952 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-6ca08a9b-c7e2-4d2f-8a1b-91e26365c512 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:27:50.638247 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-6ca08a9b-c7e2-4d2f-8a1b-91e26365c512 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:27:50.639929 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-6ca08a9b-c7e2-4d2f-8a1b-91e26365c512 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f" status: 200 len: 1407 microversion: 2.20 time: 0.206986 Jul 12 13:27:50.640742 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 21/41] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:27:50 2022] GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f => generated 1407 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:27:50.641705 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-524f83bc-3f46-4a21-8a5f-74cd7b35d3fc tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:27:50.642952 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-524f83bc-3f46-4a21-8a5f-74cd7b35d3fc tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:27:50.644004 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-524f83bc-3f46-4a21-8a5f-74cd7b35d3fc tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:27:50.644650 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-524f83bc-3f46-4a21-8a5f-74cd7b35d3fc tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:27:50.657274 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-74b41b00-096e-4475-b52f-e45efa0883dc tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:27:50.658756 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-74b41b00-096e-4475-b52f-e45efa0883dc tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: 95edada5-d3ec-4056-99e9-379fb4b65394] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:27:50.666377 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-74b41b00-096e-4475-b52f-e45efa0883dc tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:27:50.667011 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-74b41b00-096e-4475-b52f-e45efa0883dc tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:27:50.667903 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-74b41b00-096e-4475-b52f-e45efa0883dc tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:27:50.668510 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-74b41b00-096e-4475-b52f-e45efa0883dc tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:27:50.775992 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-524f83bc-3f46-4a21-8a5f-74cd7b35d3fc tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbc8ad40b44661b526511ecbc51027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd44719e63bb947bdb13e9309d1576521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:27:50.791811 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-524f83bc-3f46-4a21-8a5f-74cd7b35d3fc tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] 10.222.0.23 "GET /compute/v2.1/servers/fa6eab49-6809-41fa-96c5-a6297dbe51d6" status: 200 len: 1267 microversion: 2.1 time: 0.167509 Jul 12 13:27:50.792852 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 21/42] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:27:50 2022] GET /compute/v2.1/servers/fa6eab49-6809-41fa-96c5-a6297dbe51d6 => generated 1267 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:27:50.846962 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-74b41b00-096e-4475-b52f-e45efa0883dc tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f448776d1074e22bfe6cfbe05e01db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27fe465e6743e19feec424e6e9f3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:27:50.859893 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-74b41b00-096e-4475-b52f-e45efa0883dc tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394" status: 200 len: 1225 microversion: 2.1 time: 0.217166 Jul 12 13:27:50.872459 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 22/43] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:27:50 2022] GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394 => generated 1225 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:27:51.038889 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-a7162395-b3fa-4426-9cc5-d886db55d3c1 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:27:51.039841 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-a7162395-b3fa-4426-9cc5-d886db55d3c1 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] [instance: eeb0b554-cd09-49b5-95f0-22fc7c707944] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:27:51.050541 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-a7162395-b3fa-4426-9cc5-d886db55d3c1 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:27:51.051250 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-a7162395-b3fa-4426-9cc5-d886db55d3c1 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:27:51.052405 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-a7162395-b3fa-4426-9cc5-d886db55d3c1 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:27:51.053011 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-a7162395-b3fa-4426-9cc5-d886db55d3c1 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:27:51.191363 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-a7162395-b3fa-4426-9cc5-d886db55d3c1 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b710bbdf0c4d58b4f3ee7ef7410c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8fca4ab6ed466a864c5551fea5f7ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:27:51.199717 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-a7162395-b3fa-4426-9cc5-d886db55d3c1 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] 10.222.0.23 "GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944" status: 200 len: 1308 microversion: 2.1 time: 0.167550 Jul 12 13:27:51.200700 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 22/44] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:27:51 2022] GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944 => generated 1308 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:27:51.659041 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-92883952-52e6-4745-8cb7-2f17e307e231 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:27:51.659694 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-92883952-52e6-4745-8cb7-2f17e307e231 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 5d30ed54-909d-491f-a14c-bc4435cfdc6f] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:27:51.666081 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-92883952-52e6-4745-8cb7-2f17e307e231 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:27:51.666530 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-92883952-52e6-4745-8cb7-2f17e307e231 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:27:51.667296 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-92883952-52e6-4745-8cb7-2f17e307e231 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:27:51.667753 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-92883952-52e6-4745-8cb7-2f17e307e231 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:27:51.809925 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-515c057f-7258-44f2-bba8-6cf7d2dc45a5 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:27:51.810687 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-515c057f-7258-44f2-bba8-6cf7d2dc45a5 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] [instance: fa6eab49-6809-41fa-96c5-a6297dbe51d6] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:27:51.813117 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG dbcounter [-] [117988] Writing DB stats nova_cell0:SELECT=6 {{(pid=117988) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:51.819497 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-515c057f-7258-44f2-bba8-6cf7d2dc45a5 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:27:51.819639 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-92883952-52e6-4745-8cb7-2f17e307e231 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:27:51.819953 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-515c057f-7258-44f2-bba8-6cf7d2dc45a5 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:27:51.820730 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-515c057f-7258-44f2-bba8-6cf7d2dc45a5 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:27:51.821347 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-515c057f-7258-44f2-bba8-6cf7d2dc45a5 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:27:51.828612 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-92883952-52e6-4745-8cb7-2f17e307e231 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:27:51.831798 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-92883952-52e6-4745-8cb7-2f17e307e231 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:27:51.833553 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-92883952-52e6-4745-8cb7-2f17e307e231 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f" status: 200 len: 1407 microversion: 2.20 time: 0.178707 Jul 12 13:27:51.834575 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 23/45] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:27:51 2022] GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f => generated 1407 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:27:51.881595 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-1b209462-59ef-4ee0-b1db-98f854547fba tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:27:51.882537 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-1b209462-59ef-4ee0-b1db-98f854547fba tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: 95edada5-d3ec-4056-99e9-379fb4b65394] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:27:51.888654 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-1b209462-59ef-4ee0-b1db-98f854547fba tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:27:51.889131 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-1b209462-59ef-4ee0-b1db-98f854547fba tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:27:51.889894 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-1b209462-59ef-4ee0-b1db-98f854547fba tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:27:51.890445 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-1b209462-59ef-4ee0-b1db-98f854547fba tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:27:51.895814 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-515c057f-7258-44f2-bba8-6cf7d2dc45a5 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbc8ad40b44661b526511ecbc51027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd44719e63bb947bdb13e9309d1576521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:27:51.906552 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-515c057f-7258-44f2-bba8-6cf7d2dc45a5 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] 10.222.0.23 "GET /compute/v2.1/servers/fa6eab49-6809-41fa-96c5-a6297dbe51d6" status: 200 len: 1267 microversion: 2.1 time: 0.099926 Jul 12 13:27:51.907195 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 23/46] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:27:51 2022] GET /compute/v2.1/servers/fa6eab49-6809-41fa-96c5-a6297dbe51d6 => generated 1267 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:27:51.969241 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-1b209462-59ef-4ee0-b1db-98f854547fba tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f448776d1074e22bfe6cfbe05e01db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27fe465e6743e19feec424e6e9f3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:27:51.978424 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-1b209462-59ef-4ee0-b1db-98f854547fba tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394" status: 200 len: 1225 microversion: 2.1 time: 0.102143 Jul 12 13:27:51.979016 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 24/47] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:27:51 2022] GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394 => generated 1225 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:27:52.216713 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-8bdb5790-b744-4763-aa6d-90513797ee2f tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:27:52.217359 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-8bdb5790-b744-4763-aa6d-90513797ee2f tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] [instance: eeb0b554-cd09-49b5-95f0-22fc7c707944] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:27:52.228735 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-8bdb5790-b744-4763-aa6d-90513797ee2f tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:27:52.228735 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-8bdb5790-b744-4763-aa6d-90513797ee2f tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:27:52.228735 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-8bdb5790-b744-4763-aa6d-90513797ee2f tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:27:52.228735 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-8bdb5790-b744-4763-aa6d-90513797ee2f tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:27:52.293973 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-8bdb5790-b744-4763-aa6d-90513797ee2f tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b710bbdf0c4d58b4f3ee7ef7410c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8fca4ab6ed466a864c5551fea5f7ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:27:52.302680 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-8bdb5790-b744-4763-aa6d-90513797ee2f tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] 10.222.0.23 "GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944" status: 200 len: 1308 microversion: 2.1 time: 0.089719 Jul 12 13:27:52.303191 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 24/48] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:27:52 2022] GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944 => generated 1308 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:27:52.852352 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-9b17a50d-87c0-4562-8d9b-30b8ea11e3cf tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:27:52.853046 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-9b17a50d-87c0-4562-8d9b-30b8ea11e3cf tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 5d30ed54-909d-491f-a14c-bc4435cfdc6f] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:27:52.855092 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG dbcounter [-] [117987] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=8 {{(pid=117987) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:52.862074 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-9b17a50d-87c0-4562-8d9b-30b8ea11e3cf tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:27:52.862232 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-9b17a50d-87c0-4562-8d9b-30b8ea11e3cf tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:27:52.863088 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-9b17a50d-87c0-4562-8d9b-30b8ea11e3cf tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:27:52.863753 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-9b17a50d-87c0-4562-8d9b-30b8ea11e3cf tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:27:52.927806 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-595ec274-6678-4ada-878c-854bd7160220 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:27:52.927806 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-595ec274-6678-4ada-878c-854bd7160220 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] [instance: fa6eab49-6809-41fa-96c5-a6297dbe51d6] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:27:52.928327 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG dbcounter [-] [117988] Writing DB stats nova_cell0:SELECT=22 {{(pid=117988) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:52.938670 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-595ec274-6678-4ada-878c-854bd7160220 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:27:52.939188 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-595ec274-6678-4ada-878c-854bd7160220 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:27:52.940751 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-595ec274-6678-4ada-878c-854bd7160220 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:27:52.941172 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-595ec274-6678-4ada-878c-854bd7160220 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:27:52.973291 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG dbcounter [-] [117988] Writing DB stats nova_cell1:SELECT=100 {{(pid=117988) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:53.042166 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-595ec274-6678-4ada-878c-854bd7160220 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbc8ad40b44661b526511ecbc51027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd44719e63bb947bdb13e9309d1576521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:27:53.055927 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-595ec274-6678-4ada-878c-854bd7160220 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] 10.222.0.23 "GET /compute/v2.1/servers/fa6eab49-6809-41fa-96c5-a6297dbe51d6" status: 200 len: 1267 microversion: 2.1 time: 0.134701 Jul 12 13:27:53.057080 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 25/49] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:27:52 2022] GET /compute/v2.1/servers/fa6eab49-6809-41fa-96c5-a6297dbe51d6 => generated 1267 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:27:53.062051 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-072339c0-1138-4154-affe-ec50d8117257 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:27:53.063180 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-072339c0-1138-4154-affe-ec50d8117257 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: 95edada5-d3ec-4056-99e9-379fb4b65394] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:27:53.072300 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-072339c0-1138-4154-affe-ec50d8117257 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:27:53.073159 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-072339c0-1138-4154-affe-ec50d8117257 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:27:53.074366 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-072339c0-1138-4154-affe-ec50d8117257 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:27:53.074964 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-072339c0-1138-4154-affe-ec50d8117257 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:27:53.078144 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-9b17a50d-87c0-4562-8d9b-30b8ea11e3cf tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:27:53.088191 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-9b17a50d-87c0-4562-8d9b-30b8ea11e3cf tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:27:53.090320 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-9b17a50d-87c0-4562-8d9b-30b8ea11e3cf tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:27:53.091696 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-9b17a50d-87c0-4562-8d9b-30b8ea11e3cf tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f" status: 200 len: 1407 microversion: 2.20 time: 0.243356 Jul 12 13:27:53.092458 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 25/50] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:27:52 2022] GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f => generated 1407 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:27:53.188675 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-072339c0-1138-4154-affe-ec50d8117257 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f448776d1074e22bfe6cfbe05e01db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27fe465e6743e19feec424e6e9f3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:27:53.201605 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-072339c0-1138-4154-affe-ec50d8117257 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394" status: 200 len: 1225 microversion: 2.1 time: 0.143171 Jul 12 13:27:53.202668 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 26/51] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:27:53 2022] GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394 => generated 1225 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:27:53.320558 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-a5a08298-25e3-498b-b63c-5dea5c6fc283 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:27:53.326265 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-a5a08298-25e3-498b-b63c-5dea5c6fc283 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] [instance: eeb0b554-cd09-49b5-95f0-22fc7c707944] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:27:53.343518 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-a5a08298-25e3-498b-b63c-5dea5c6fc283 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:27:53.344269 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-a5a08298-25e3-498b-b63c-5dea5c6fc283 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:27:53.345144 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-a5a08298-25e3-498b-b63c-5dea5c6fc283 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:27:53.345610 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-a5a08298-25e3-498b-b63c-5dea5c6fc283 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:27:53.426259 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-a5a08298-25e3-498b-b63c-5dea5c6fc283 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b710bbdf0c4d58b4f3ee7ef7410c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8fca4ab6ed466a864c5551fea5f7ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:27:53.434487 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-a5a08298-25e3-498b-b63c-5dea5c6fc283 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] 10.222.0.23 "GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944" status: 200 len: 1308 microversion: 2.1 time: 0.117704 Jul 12 13:27:53.435625 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 26/52] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:27:53 2022] GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944 => generated 1308 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:27:54.074265 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-a6be8edc-b419-4198-b7d2-420e60110a08 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:27:54.075247 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-a6be8edc-b419-4198-b7d2-420e60110a08 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] [instance: fa6eab49-6809-41fa-96c5-a6297dbe51d6] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:27:54.085096 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-a6be8edc-b419-4198-b7d2-420e60110a08 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:27:54.085889 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-a6be8edc-b419-4198-b7d2-420e60110a08 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:27:54.087608 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-a6be8edc-b419-4198-b7d2-420e60110a08 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:27:54.088832 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-a6be8edc-b419-4198-b7d2-420e60110a08 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:27:54.112141 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-9619fcca-e2be-49bb-945f-1922e4ab5380 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:27:54.112940 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-9619fcca-e2be-49bb-945f-1922e4ab5380 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 5d30ed54-909d-491f-a14c-bc4435cfdc6f] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:27:54.120060 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-9619fcca-e2be-49bb-945f-1922e4ab5380 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:27:54.120743 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-9619fcca-e2be-49bb-945f-1922e4ab5380 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:27:54.121740 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-9619fcca-e2be-49bb-945f-1922e4ab5380 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:27:54.122805 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-9619fcca-e2be-49bb-945f-1922e4ab5380 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:27:54.177315 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-a6be8edc-b419-4198-b7d2-420e60110a08 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbc8ad40b44661b526511ecbc51027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd44719e63bb947bdb13e9309d1576521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:27:54.189530 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-a6be8edc-b419-4198-b7d2-420e60110a08 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] 10.222.0.23 "GET /compute/v2.1/servers/fa6eab49-6809-41fa-96c5-a6297dbe51d6" status: 200 len: 1267 microversion: 2.1 time: 0.116363 Jul 12 13:27:54.190166 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 27/53] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:27:54 2022] GET /compute/v2.1/servers/fa6eab49-6809-41fa-96c5-a6297dbe51d6 => generated 1267 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:27:54.220478 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-9c73eced-cb5b-419a-a05d-49ca8e764706 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:27:54.221306 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-9c73eced-cb5b-419a-a05d-49ca8e764706 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: 95edada5-d3ec-4056-99e9-379fb4b65394] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:27:54.239572 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-9c73eced-cb5b-419a-a05d-49ca8e764706 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:27:54.240439 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-9c73eced-cb5b-419a-a05d-49ca8e764706 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:27:54.241453 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-9c73eced-cb5b-419a-a05d-49ca8e764706 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:27:54.248569 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-9c73eced-cb5b-419a-a05d-49ca8e764706 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:27:54.360518 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-9c73eced-cb5b-419a-a05d-49ca8e764706 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f448776d1074e22bfe6cfbe05e01db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27fe465e6743e19feec424e6e9f3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:27:54.374962 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-9c73eced-cb5b-419a-a05d-49ca8e764706 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394" status: 200 len: 1225 microversion: 2.1 time: 0.158276 Jul 12 13:27:54.385990 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 28/54] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:27:54 2022] GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394 => generated 1225 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:27:54.399552 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-9619fcca-e2be-49bb-945f-1922e4ab5380 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:27:54.409557 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-9619fcca-e2be-49bb-945f-1922e4ab5380 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:27:54.412009 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-9619fcca-e2be-49bb-945f-1922e4ab5380 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:27:54.413469 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-9619fcca-e2be-49bb-945f-1922e4ab5380 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f" status: 200 len: 1407 microversion: 2.20 time: 0.306091 Jul 12 13:27:54.414231 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 27/55] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:27:54 2022] GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f => generated 1407 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 13:27:54.453625 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-cb87677d-a624-482a-a15f-fe90fa315be9 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:27:54.454287 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-cb87677d-a624-482a-a15f-fe90fa315be9 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] [instance: eeb0b554-cd09-49b5-95f0-22fc7c707944] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:27:54.458138 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG dbcounter [-] [117988] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=117988) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:54.462194 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-cb87677d-a624-482a-a15f-fe90fa315be9 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:27:54.462906 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-cb87677d-a624-482a-a15f-fe90fa315be9 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:27:54.463931 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-cb87677d-a624-482a-a15f-fe90fa315be9 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:27:54.464539 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-cb87677d-a624-482a-a15f-fe90fa315be9 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:27:54.560570 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-cb87677d-a624-482a-a15f-fe90fa315be9 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b710bbdf0c4d58b4f3ee7ef7410c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8fca4ab6ed466a864c5551fea5f7ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:27:54.573767 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-cb87677d-a624-482a-a15f-fe90fa315be9 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] 10.222.0.23 "GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944" status: 200 len: 1308 microversion: 2.1 time: 0.124259 Jul 12 13:27:54.578960 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 29/56] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:27:54 2022] GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944 => generated 1308 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:27:55.206901 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-6f1a1b9c-f859-41b9-9916-c1ba8bcaf89f tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:27:55.207796 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-6f1a1b9c-f859-41b9-9916-c1ba8bcaf89f tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] [instance: fa6eab49-6809-41fa-96c5-a6297dbe51d6] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:27:55.213872 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-6f1a1b9c-f859-41b9-9916-c1ba8bcaf89f tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:27:55.214327 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-6f1a1b9c-f859-41b9-9916-c1ba8bcaf89f tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:27:55.215099 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-6f1a1b9c-f859-41b9-9916-c1ba8bcaf89f tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:27:55.215705 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-6f1a1b9c-f859-41b9-9916-c1ba8bcaf89f tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:27:55.220902 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG dbcounter [-] [117987] Writing DB stats nova_cell1:SELECT=100 {{(pid=117987) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:55.307064 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-6f1a1b9c-f859-41b9-9916-c1ba8bcaf89f tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbc8ad40b44661b526511ecbc51027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd44719e63bb947bdb13e9309d1576521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:27:55.316317 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-6f1a1b9c-f859-41b9-9916-c1ba8bcaf89f tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] 10.222.0.23 "GET /compute/v2.1/servers/fa6eab49-6809-41fa-96c5-a6297dbe51d6" status: 200 len: 1267 microversion: 2.1 time: 0.114017 Jul 12 13:27:55.316978 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 28/57] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:27:55 2022] GET /compute/v2.1/servers/fa6eab49-6809-41fa-96c5-a6297dbe51d6 => generated 1267 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:27:55.393457 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-de323d8a-c86c-4530-9981-276a5207284b tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:27:55.394809 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-de323d8a-c86c-4530-9981-276a5207284b tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: 95edada5-d3ec-4056-99e9-379fb4b65394] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:27:55.401341 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-de323d8a-c86c-4530-9981-276a5207284b tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:27:55.402173 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-de323d8a-c86c-4530-9981-276a5207284b tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:27:55.403120 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-de323d8a-c86c-4530-9981-276a5207284b tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:27:55.403716 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-de323d8a-c86c-4530-9981-276a5207284b tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:27:55.432787 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-b8133f72-d7a7-4b96-b555-daa9e180955d tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:27:55.433851 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-b8133f72-d7a7-4b96-b555-daa9e180955d tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 5d30ed54-909d-491f-a14c-bc4435cfdc6f] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:27:55.446175 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-b8133f72-d7a7-4b96-b555-daa9e180955d tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:27:55.446631 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-b8133f72-d7a7-4b96-b555-daa9e180955d tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:27:55.447416 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-b8133f72-d7a7-4b96-b555-daa9e180955d tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:27:55.448236 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-b8133f72-d7a7-4b96-b555-daa9e180955d tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:27:55.486611 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-de323d8a-c86c-4530-9981-276a5207284b tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f448776d1074e22bfe6cfbe05e01db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27fe465e6743e19feec424e6e9f3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:27:55.495453 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-de323d8a-c86c-4530-9981-276a5207284b tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394" status: 200 len: 1225 microversion: 2.1 time: 0.105856 Jul 12 13:27:55.496000 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 30/58] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:27:55 2022] GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394 => generated 1225 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:27:55.554399 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG dbcounter [-] [117987] Writing DB stats nova_cell0:SELECT=26 {{(pid=117987) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:55.592085 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-eb1af9ce-9bfb-4402-82d0-313948498467 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:27:55.592803 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-eb1af9ce-9bfb-4402-82d0-313948498467 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] [instance: eeb0b554-cd09-49b5-95f0-22fc7c707944] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:27:55.599421 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-eb1af9ce-9bfb-4402-82d0-313948498467 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:27:55.599873 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-eb1af9ce-9bfb-4402-82d0-313948498467 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:27:55.600649 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-eb1af9ce-9bfb-4402-82d0-313948498467 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:27:55.601081 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-eb1af9ce-9bfb-4402-82d0-313948498467 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:27:55.608864 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-b8133f72-d7a7-4b96-b555-daa9e180955d tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:27:55.619989 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-b8133f72-d7a7-4b96-b555-daa9e180955d tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:27:55.621522 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-b8133f72-d7a7-4b96-b555-daa9e180955d tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:27:55.623034 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-b8133f72-d7a7-4b96-b555-daa9e180955d tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f" status: 200 len: 1407 microversion: 2.20 time: 0.194028 Jul 12 13:27:55.623545 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 29/59] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:27:55 2022] GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f => generated 1407 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:27:55.675797 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-eb1af9ce-9bfb-4402-82d0-313948498467 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b710bbdf0c4d58b4f3ee7ef7410c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8fca4ab6ed466a864c5551fea5f7ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:27:55.683972 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-eb1af9ce-9bfb-4402-82d0-313948498467 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] 10.222.0.23 "GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944" status: 200 len: 1308 microversion: 2.1 time: 0.095831 Jul 12 13:27:55.684553 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 31/60] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:27:55 2022] GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944 => generated 1308 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:27:56.338427 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-250743f5-e5de-4649-9b0c-1ab82db72591 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:27:56.341521 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-250743f5-e5de-4649-9b0c-1ab82db72591 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] [instance: fa6eab49-6809-41fa-96c5-a6297dbe51d6] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:27:56.353034 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-250743f5-e5de-4649-9b0c-1ab82db72591 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:27:56.354759 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-250743f5-e5de-4649-9b0c-1ab82db72591 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:27:56.356213 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-250743f5-e5de-4649-9b0c-1ab82db72591 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:27:56.357499 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-250743f5-e5de-4649-9b0c-1ab82db72591 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:27:56.462310 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-250743f5-e5de-4649-9b0c-1ab82db72591 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbc8ad40b44661b526511ecbc51027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd44719e63bb947bdb13e9309d1576521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:27:56.483918 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-250743f5-e5de-4649-9b0c-1ab82db72591 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] 10.222.0.23 "GET /compute/v2.1/servers/fa6eab49-6809-41fa-96c5-a6297dbe51d6" status: 200 len: 1267 microversion: 2.1 time: 0.152018 Jul 12 13:27:56.493658 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 30/61] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:27:56 2022] GET /compute/v2.1/servers/fa6eab49-6809-41fa-96c5-a6297dbe51d6 => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:27:56.518519 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-e44ea3c9-59dd-413c-9102-38a506db32eb tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:27:56.520035 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-e44ea3c9-59dd-413c-9102-38a506db32eb tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: 95edada5-d3ec-4056-99e9-379fb4b65394] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:27:56.531631 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-e44ea3c9-59dd-413c-9102-38a506db32eb tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:27:56.532437 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-e44ea3c9-59dd-413c-9102-38a506db32eb tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:27:56.533965 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-e44ea3c9-59dd-413c-9102-38a506db32eb tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:27:56.534700 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-e44ea3c9-59dd-413c-9102-38a506db32eb tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:27:56.611680 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-e44ea3c9-59dd-413c-9102-38a506db32eb tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f448776d1074e22bfe6cfbe05e01db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27fe465e6743e19feec424e6e9f3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:27:56.622319 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-e44ea3c9-59dd-413c-9102-38a506db32eb tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394" status: 200 len: 1225 microversion: 2.1 time: 0.111380 Jul 12 13:27:56.632915 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 32/62] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:27:56 2022] GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394 => generated 1225 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:27:56.644923 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-ea9f1bc6-7de3-484a-9863-246155d11f49 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:27:56.646407 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-ea9f1bc6-7de3-484a-9863-246155d11f49 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 5d30ed54-909d-491f-a14c-bc4435cfdc6f] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:27:56.654680 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-ea9f1bc6-7de3-484a-9863-246155d11f49 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:27:56.655563 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-ea9f1bc6-7de3-484a-9863-246155d11f49 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:27:56.656680 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-ea9f1bc6-7de3-484a-9863-246155d11f49 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:27:56.657274 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-ea9f1bc6-7de3-484a-9863-246155d11f49 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:27:56.702708 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-f49198b8-47a7-4b7c-b381-72c079618ee5 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:27:56.703574 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-f49198b8-47a7-4b7c-b381-72c079618ee5 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] [instance: eeb0b554-cd09-49b5-95f0-22fc7c707944] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:27:56.713684 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-f49198b8-47a7-4b7c-b381-72c079618ee5 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:27:56.715738 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-f49198b8-47a7-4b7c-b381-72c079618ee5 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:27:56.716729 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-f49198b8-47a7-4b7c-b381-72c079618ee5 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:27:56.717961 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-f49198b8-47a7-4b7c-b381-72c079618ee5 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:27:56.947611 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-f49198b8-47a7-4b7c-b381-72c079618ee5 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b710bbdf0c4d58b4f3ee7ef7410c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8fca4ab6ed466a864c5551fea5f7ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:27:56.956039 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-f49198b8-47a7-4b7c-b381-72c079618ee5 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] 10.222.0.23 "GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944" status: 200 len: 1308 microversion: 2.1 time: 0.257578 Jul 12 13:27:56.956626 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 33/63] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:27:56 2022] GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944 => generated 1308 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:27:57.031359 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-ea9f1bc6-7de3-484a-9863-246155d11f49 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:27:57.042368 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-ea9f1bc6-7de3-484a-9863-246155d11f49 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:27:57.044026 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-ea9f1bc6-7de3-484a-9863-246155d11f49 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:27:57.045244 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-ea9f1bc6-7de3-484a-9863-246155d11f49 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f" status: 200 len: 1407 microversion: 2.20 time: 0.407017 Jul 12 13:27:57.045911 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 31/64] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:27:56 2022] GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f => generated 1407 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:27:57.510739 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-d1e88e8d-b46f-42f2-bd78-863e7315df84 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:27:57.511785 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-d1e88e8d-b46f-42f2-bd78-863e7315df84 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] [instance: fa6eab49-6809-41fa-96c5-a6297dbe51d6] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:27:57.524657 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-d1e88e8d-b46f-42f2-bd78-863e7315df84 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:27:57.527224 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-d1e88e8d-b46f-42f2-bd78-863e7315df84 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:27:57.529163 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-d1e88e8d-b46f-42f2-bd78-863e7315df84 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:27:57.532917 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-d1e88e8d-b46f-42f2-bd78-863e7315df84 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:27:57.640962 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-e6aeff00-a266-434b-a349-56ad5362c536 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:27:57.642161 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-e6aeff00-a266-434b-a349-56ad5362c536 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: 95edada5-d3ec-4056-99e9-379fb4b65394] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:27:57.660468 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-e6aeff00-a266-434b-a349-56ad5362c536 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:27:57.661190 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-e6aeff00-a266-434b-a349-56ad5362c536 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:27:57.662556 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-e6aeff00-a266-434b-a349-56ad5362c536 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:27:57.663225 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-e6aeff00-a266-434b-a349-56ad5362c536 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:27:57.677055 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-d1e88e8d-b46f-42f2-bd78-863e7315df84 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbc8ad40b44661b526511ecbc51027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd44719e63bb947bdb13e9309d1576521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:27:57.695242 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-d1e88e8d-b46f-42f2-bd78-863e7315df84 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] 10.222.0.23 "GET /compute/v2.1/servers/fa6eab49-6809-41fa-96c5-a6297dbe51d6" status: 200 len: 1267 microversion: 2.1 time: 0.194662 Jul 12 13:27:57.695841 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 34/65] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:27:57 2022] GET /compute/v2.1/servers/fa6eab49-6809-41fa-96c5-a6297dbe51d6 => generated 1267 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:27:57.770005 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-e6aeff00-a266-434b-a349-56ad5362c536 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f448776d1074e22bfe6cfbe05e01db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27fe465e6743e19feec424e6e9f3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:27:57.779993 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-e6aeff00-a266-434b-a349-56ad5362c536 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394" status: 200 len: 1225 microversion: 2.1 time: 0.143310 Jul 12 13:27:57.781397 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 32/66] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:27:57 2022] GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394 => generated 1225 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:27:57.977102 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-bb091dbb-f245-445e-bd45-fe7e48e8f8cb tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:27:57.978271 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-bb091dbb-f245-445e-bd45-fe7e48e8f8cb tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] [instance: eeb0b554-cd09-49b5-95f0-22fc7c707944] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:27:57.990528 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-bb091dbb-f245-445e-bd45-fe7e48e8f8cb tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:27:57.990974 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-bb091dbb-f245-445e-bd45-fe7e48e8f8cb tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:27:57.992226 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-bb091dbb-f245-445e-bd45-fe7e48e8f8cb tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:27:57.992679 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-bb091dbb-f245-445e-bd45-fe7e48e8f8cb tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:27:58.065764 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-08289af9-18b7-42d1-872c-8e9b810c16d3 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:27:58.066407 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-08289af9-18b7-42d1-872c-8e9b810c16d3 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 5d30ed54-909d-491f-a14c-bc4435cfdc6f] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:27:58.076997 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-08289af9-18b7-42d1-872c-8e9b810c16d3 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:27:58.078907 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-08289af9-18b7-42d1-872c-8e9b810c16d3 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:27:58.081214 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-08289af9-18b7-42d1-872c-8e9b810c16d3 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:27:58.081845 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-08289af9-18b7-42d1-872c-8e9b810c16d3 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:27:58.111764 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-bb091dbb-f245-445e-bd45-fe7e48e8f8cb tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b710bbdf0c4d58b4f3ee7ef7410c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8fca4ab6ed466a864c5551fea5f7ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:27:58.121275 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-bb091dbb-f245-445e-bd45-fe7e48e8f8cb tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] 10.222.0.23 "GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944" status: 200 len: 1308 microversion: 2.1 time: 0.149100 Jul 12 13:27:58.122148 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 35/67] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:27:57 2022] GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944 => generated 1308 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:27:58.130666 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG dbcounter [-] [117987] Writing DB stats nova_cell0:SELECT=6 {{(pid=117987) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:58.307323 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-08289af9-18b7-42d1-872c-8e9b810c16d3 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:27:58.318963 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-08289af9-18b7-42d1-872c-8e9b810c16d3 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:27:58.321560 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-08289af9-18b7-42d1-872c-8e9b810c16d3 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:27:58.323112 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-08289af9-18b7-42d1-872c-8e9b810c16d3 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f" status: 200 len: 1407 microversion: 2.20 time: 0.262604 Jul 12 13:27:58.323675 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 33/68] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:27:58 2022] GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f => generated 1407 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 13:27:58.717779 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-bc3afd44-7220-49dc-9512-3272c90fd264 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:27:58.719075 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-bc3afd44-7220-49dc-9512-3272c90fd264 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] [instance: fa6eab49-6809-41fa-96c5-a6297dbe51d6] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:27:58.730248 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-bc3afd44-7220-49dc-9512-3272c90fd264 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:27:58.730691 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-bc3afd44-7220-49dc-9512-3272c90fd264 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:27:58.731721 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-bc3afd44-7220-49dc-9512-3272c90fd264 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:27:58.732174 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-bc3afd44-7220-49dc-9512-3272c90fd264 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:27:58.799827 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-0cf3e061-2e6a-4d5b-bddb-e5302aa5f63d tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:27:58.801207 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-0cf3e061-2e6a-4d5b-bddb-e5302aa5f63d tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: 95edada5-d3ec-4056-99e9-379fb4b65394] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:27:58.805533 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-bc3afd44-7220-49dc-9512-3272c90fd264 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbc8ad40b44661b526511ecbc51027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd44719e63bb947bdb13e9309d1576521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:27:58.808052 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-0cf3e061-2e6a-4d5b-bddb-e5302aa5f63d tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:27:58.808431 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-0cf3e061-2e6a-4d5b-bddb-e5302aa5f63d tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:27:58.809706 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-0cf3e061-2e6a-4d5b-bddb-e5302aa5f63d tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:27:58.810117 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-0cf3e061-2e6a-4d5b-bddb-e5302aa5f63d tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:27:58.813839 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-bc3afd44-7220-49dc-9512-3272c90fd264 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] 10.222.0.23 "GET /compute/v2.1/servers/fa6eab49-6809-41fa-96c5-a6297dbe51d6" status: 200 len: 1267 microversion: 2.1 time: 0.101917 Jul 12 13:27:58.823916 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 36/69] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:27:58 2022] GET /compute/v2.1/servers/fa6eab49-6809-41fa-96c5-a6297dbe51d6 => generated 1267 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:27:58.880814 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-0cf3e061-2e6a-4d5b-bddb-e5302aa5f63d tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f448776d1074e22bfe6cfbe05e01db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27fe465e6743e19feec424e6e9f3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:27:58.888665 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-0cf3e061-2e6a-4d5b-bddb-e5302aa5f63d tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394" status: 200 len: 1225 microversion: 2.1 time: 0.094203 Jul 12 13:27:58.889276 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 34/70] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:27:58 2022] GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394 => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:27:59.143257 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-b004133d-695c-4fcd-b40f-02f618653388 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:27:59.143903 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-b004133d-695c-4fcd-b40f-02f618653388 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] [instance: eeb0b554-cd09-49b5-95f0-22fc7c707944] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:27:59.150024 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-b004133d-695c-4fcd-b40f-02f618653388 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:27:59.150459 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-b004133d-695c-4fcd-b40f-02f618653388 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:27:59.151226 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-b004133d-695c-4fcd-b40f-02f618653388 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:27:59.151657 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-b004133d-695c-4fcd-b40f-02f618653388 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:27:59.219263 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-b004133d-695c-4fcd-b40f-02f618653388 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b710bbdf0c4d58b4f3ee7ef7410c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8fca4ab6ed466a864c5551fea5f7ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:27:59.229140 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-b004133d-695c-4fcd-b40f-02f618653388 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] 10.222.0.23 "GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944" status: 200 len: 1308 microversion: 2.1 time: 0.090536 Jul 12 13:27:59.229765 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 37/71] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:27:59 2022] GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944 => generated 1308 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:27:59.344688 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-ae741cdf-6a23-43cd-9c7b-294f28894a1f tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:27:59.346493 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-ae741cdf-6a23-43cd-9c7b-294f28894a1f tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 5d30ed54-909d-491f-a14c-bc4435cfdc6f] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:27:59.352533 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-ae741cdf-6a23-43cd-9c7b-294f28894a1f tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:27:59.352971 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-ae741cdf-6a23-43cd-9c7b-294f28894a1f tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:27:59.353811 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-ae741cdf-6a23-43cd-9c7b-294f28894a1f tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:27:59.354248 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-ae741cdf-6a23-43cd-9c7b-294f28894a1f tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:27:59.522975 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-ae741cdf-6a23-43cd-9c7b-294f28894a1f tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:27:59.534545 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-ae741cdf-6a23-43cd-9c7b-294f28894a1f tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:27:59.536272 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-ae741cdf-6a23-43cd-9c7b-294f28894a1f tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:27:59.538590 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-ae741cdf-6a23-43cd-9c7b-294f28894a1f tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f" status: 200 len: 1407 microversion: 2.20 time: 0.199084 Jul 12 13:27:59.539829 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 35/72] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:27:59 2022] GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f => generated 1407 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:27:59.837892 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-f06154ed-e0c0-4f5a-8eb4-df14cfec6707 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:27:59.838676 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-f06154ed-e0c0-4f5a-8eb4-df14cfec6707 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] [instance: fa6eab49-6809-41fa-96c5-a6297dbe51d6] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:27:59.846369 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-f06154ed-e0c0-4f5a-8eb4-df14cfec6707 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:27:59.847131 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-f06154ed-e0c0-4f5a-8eb4-df14cfec6707 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:27:59.848027 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-f06154ed-e0c0-4f5a-8eb4-df14cfec6707 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:27:59.849478 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-f06154ed-e0c0-4f5a-8eb4-df14cfec6707 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:27:59.911993 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-e1c371d8-1a09-4803-95ff-2745dcf3a07c tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:27:59.913216 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-e1c371d8-1a09-4803-95ff-2745dcf3a07c tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: 95edada5-d3ec-4056-99e9-379fb4b65394] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:27:59.924664 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-e1c371d8-1a09-4803-95ff-2745dcf3a07c tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:27:59.925326 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-e1c371d8-1a09-4803-95ff-2745dcf3a07c tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:27:59.926623 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-e1c371d8-1a09-4803-95ff-2745dcf3a07c tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:27:59.927301 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-e1c371d8-1a09-4803-95ff-2745dcf3a07c tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:27:59.932631 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-f06154ed-e0c0-4f5a-8eb4-df14cfec6707 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbc8ad40b44661b526511ecbc51027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd44719e63bb947bdb13e9309d1576521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:27:59.943214 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-f06154ed-e0c0-4f5a-8eb4-df14cfec6707 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] 10.222.0.23 "GET /compute/v2.1/servers/fa6eab49-6809-41fa-96c5-a6297dbe51d6" status: 200 len: 1267 microversion: 2.1 time: 0.115066 Jul 12 13:27:59.944154 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 38/73] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:27:59 2022] GET /compute/v2.1/servers/fa6eab49-6809-41fa-96c5-a6297dbe51d6 => generated 1267 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:28:00.017650 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-e1c371d8-1a09-4803-95ff-2745dcf3a07c tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f448776d1074e22bfe6cfbe05e01db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27fe465e6743e19feec424e6e9f3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:00.026855 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-e1c371d8-1a09-4803-95ff-2745dcf3a07c tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394" status: 200 len: 1225 microversion: 2.1 time: 0.121788 Jul 12 13:28:00.027459 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 36/74] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:27:59 2022] GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394 => generated 1225 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:28:00.246730 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-4d892f8d-fbed-4d31-a2f7-c79c390f9d97 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:28:00.247359 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-4d892f8d-fbed-4d31-a2f7-c79c390f9d97 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] [instance: eeb0b554-cd09-49b5-95f0-22fc7c707944] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:28:00.255909 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-4d892f8d-fbed-4d31-a2f7-c79c390f9d97 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:00.256571 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-4d892f8d-fbed-4d31-a2f7-c79c390f9d97 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:00.257807 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-4d892f8d-fbed-4d31-a2f7-c79c390f9d97 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:00.258309 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-4d892f8d-fbed-4d31-a2f7-c79c390f9d97 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:00.325263 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-4d892f8d-fbed-4d31-a2f7-c79c390f9d97 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b710bbdf0c4d58b4f3ee7ef7410c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8fca4ab6ed466a864c5551fea5f7ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:00.334325 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-4d892f8d-fbed-4d31-a2f7-c79c390f9d97 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] 10.222.0.23 "GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944" status: 200 len: 1308 microversion: 2.1 time: 0.091694 Jul 12 13:28:00.334919 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 39/75] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:28:00 2022] GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944 => generated 1308 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:28:00.557823 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-68486229-aec8-4b24-9548-8e13fe95a4b1 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:28:00.558437 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-68486229-aec8-4b24-9548-8e13fe95a4b1 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 5d30ed54-909d-491f-a14c-bc4435cfdc6f] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:28:00.566423 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-68486229-aec8-4b24-9548-8e13fe95a4b1 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:00.566875 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-68486229-aec8-4b24-9548-8e13fe95a4b1 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:00.567652 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-68486229-aec8-4b24-9548-8e13fe95a4b1 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:00.568089 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-68486229-aec8-4b24-9548-8e13fe95a4b1 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:00.706913 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-68486229-aec8-4b24-9548-8e13fe95a4b1 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:00.715129 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-68486229-aec8-4b24-9548-8e13fe95a4b1 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:00.716707 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-68486229-aec8-4b24-9548-8e13fe95a4b1 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:00.717859 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-68486229-aec8-4b24-9548-8e13fe95a4b1 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f" status: 200 len: 1407 microversion: 2.20 time: 0.163947 Jul 12 13:28:00.718601 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 37/76] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:28:00 2022] GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f => generated 1407 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:28:00.960906 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-52f24653-2771-4bad-8488-fba863bfbfa5 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:28:00.961574 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-52f24653-2771-4bad-8488-fba863bfbfa5 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] [instance: fa6eab49-6809-41fa-96c5-a6297dbe51d6] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:28:00.968304 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-52f24653-2771-4bad-8488-fba863bfbfa5 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:00.968780 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-52f24653-2771-4bad-8488-fba863bfbfa5 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:00.970195 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-52f24653-2771-4bad-8488-fba863bfbfa5 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:00.970701 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-52f24653-2771-4bad-8488-fba863bfbfa5 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:01.043629 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-52f24653-2771-4bad-8488-fba863bfbfa5 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbc8ad40b44661b526511ecbc51027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd44719e63bb947bdb13e9309d1576521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:01.045261 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-c700c933-c1d9-4e9a-98b0-5b9bfe42e036 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:28:01.046640 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-c700c933-c1d9-4e9a-98b0-5b9bfe42e036 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: 95edada5-d3ec-4056-99e9-379fb4b65394] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:28:01.053908 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-52f24653-2771-4bad-8488-fba863bfbfa5 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] 10.222.0.23 "GET /compute/v2.1/servers/fa6eab49-6809-41fa-96c5-a6297dbe51d6" status: 200 len: 1267 microversion: 2.1 time: 0.096827 Jul 12 13:28:01.054340 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-c700c933-c1d9-4e9a-98b0-5b9bfe42e036 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:01.054651 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 40/77] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:28:00 2022] GET /compute/v2.1/servers/fa6eab49-6809-41fa-96c5-a6297dbe51d6 => generated 1267 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:28:01.055165 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-c700c933-c1d9-4e9a-98b0-5b9bfe42e036 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:01.056406 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-c700c933-c1d9-4e9a-98b0-5b9bfe42e036 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:01.056547 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-c700c933-c1d9-4e9a-98b0-5b9bfe42e036 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:01.121636 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-c700c933-c1d9-4e9a-98b0-5b9bfe42e036 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f448776d1074e22bfe6cfbe05e01db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27fe465e6743e19feec424e6e9f3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:01.129980 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-c700c933-c1d9-4e9a-98b0-5b9bfe42e036 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394" status: 200 len: 1225 microversion: 2.1 time: 0.089201 Jul 12 13:28:01.130558 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 38/78] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:28:01 2022] GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394 => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:28:01.351329 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-8d4bb1f1-0422-4f50-ae6c-00ef67ec1015 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:28:01.351941 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-8d4bb1f1-0422-4f50-ae6c-00ef67ec1015 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] [instance: eeb0b554-cd09-49b5-95f0-22fc7c707944] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:28:01.358051 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-8d4bb1f1-0422-4f50-ae6c-00ef67ec1015 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:01.358496 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-8d4bb1f1-0422-4f50-ae6c-00ef67ec1015 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:01.359261 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-8d4bb1f1-0422-4f50-ae6c-00ef67ec1015 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:01.359693 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-8d4bb1f1-0422-4f50-ae6c-00ef67ec1015 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:01.427687 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-8d4bb1f1-0422-4f50-ae6c-00ef67ec1015 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b710bbdf0c4d58b4f3ee7ef7410c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8fca4ab6ed466a864c5551fea5f7ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:01.435150 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-8d4bb1f1-0422-4f50-ae6c-00ef67ec1015 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] 10.222.0.23 "GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944" status: 200 len: 1308 microversion: 2.1 time: 0.087598 Jul 12 13:28:01.435731 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 41/79] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:28:01 2022] GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944 => generated 1308 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:28:01.736575 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-929baabd-36fe-4ab4-b2e0-a1b2377c1707 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:28:01.737177 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-929baabd-36fe-4ab4-b2e0-a1b2377c1707 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 5d30ed54-909d-491f-a14c-bc4435cfdc6f] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:28:01.743184 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-929baabd-36fe-4ab4-b2e0-a1b2377c1707 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:01.744050 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-929baabd-36fe-4ab4-b2e0-a1b2377c1707 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:01.744813 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-929baabd-36fe-4ab4-b2e0-a1b2377c1707 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:01.745244 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-929baabd-36fe-4ab4-b2e0-a1b2377c1707 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:01.875300 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-929baabd-36fe-4ab4-b2e0-a1b2377c1707 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:01.883524 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-929baabd-36fe-4ab4-b2e0-a1b2377c1707 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:01.885021 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-929baabd-36fe-4ab4-b2e0-a1b2377c1707 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:01.886157 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-929baabd-36fe-4ab4-b2e0-a1b2377c1707 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f" status: 200 len: 1407 microversion: 2.20 time: 0.154127 Jul 12 13:28:01.886702 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 39/80] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:28:01 2022] GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:28:02.071757 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-e4117d5f-783f-459c-8447-47afcaeb6d01 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:28:02.072373 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-e4117d5f-783f-459c-8447-47afcaeb6d01 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] [instance: fa6eab49-6809-41fa-96c5-a6297dbe51d6] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:28:02.078450 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-e4117d5f-783f-459c-8447-47afcaeb6d01 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:02.078902 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-e4117d5f-783f-459c-8447-47afcaeb6d01 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:02.080234 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-e4117d5f-783f-459c-8447-47afcaeb6d01 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:02.080645 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-e4117d5f-783f-459c-8447-47afcaeb6d01 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:02.085287 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG dbcounter [-] [117988] Writing DB stats nova_cell1:SELECT=100 {{(pid=117988) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:02.146939 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-d76e812a-0f3f-46b3-a186-60f8cb4004c2 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:28:02.147368 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-e4117d5f-783f-459c-8447-47afcaeb6d01 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbc8ad40b44661b526511ecbc51027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd44719e63bb947bdb13e9309d1576521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:02.147557 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-d76e812a-0f3f-46b3-a186-60f8cb4004c2 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: 95edada5-d3ec-4056-99e9-379fb4b65394] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:28:02.153835 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-d76e812a-0f3f-46b3-a186-60f8cb4004c2 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:02.154286 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-d76e812a-0f3f-46b3-a186-60f8cb4004c2 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:02.155088 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-d76e812a-0f3f-46b3-a186-60f8cb4004c2 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:02.155521 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-d76e812a-0f3f-46b3-a186-60f8cb4004c2 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:02.155718 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-e4117d5f-783f-459c-8447-47afcaeb6d01 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] 10.222.0.23 "GET /compute/v2.1/servers/fa6eab49-6809-41fa-96c5-a6297dbe51d6" status: 200 len: 1267 microversion: 2.1 time: 0.087510 Jul 12 13:28:02.156134 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 42/81] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:28:02 2022] GET /compute/v2.1/servers/fa6eab49-6809-41fa-96c5-a6297dbe51d6 => generated 1267 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:28:02.217660 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-d76e812a-0f3f-46b3-a186-60f8cb4004c2 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f448776d1074e22bfe6cfbe05e01db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27fe465e6743e19feec424e6e9f3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:02.226093 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-d76e812a-0f3f-46b3-a186-60f8cb4004c2 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394" status: 200 len: 1225 microversion: 2.1 time: 0.082889 Jul 12 13:28:02.226863 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 40/82] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:28:02 2022] GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:28:02.452702 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-90450b66-7092-4f8e-8ca0-cd938fd7b58a tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:28:02.453331 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-90450b66-7092-4f8e-8ca0-cd938fd7b58a tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] [instance: eeb0b554-cd09-49b5-95f0-22fc7c707944] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:28:02.460139 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-90450b66-7092-4f8e-8ca0-cd938fd7b58a tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:02.460575 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-90450b66-7092-4f8e-8ca0-cd938fd7b58a tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:02.461330 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-90450b66-7092-4f8e-8ca0-cd938fd7b58a tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:02.461781 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-90450b66-7092-4f8e-8ca0-cd938fd7b58a tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:02.525003 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-90450b66-7092-4f8e-8ca0-cd938fd7b58a tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b710bbdf0c4d58b4f3ee7ef7410c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8fca4ab6ed466a864c5551fea5f7ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:02.532648 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-90450b66-7092-4f8e-8ca0-cd938fd7b58a tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] 10.222.0.23 "GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944" status: 200 len: 1308 microversion: 2.1 time: 0.083595 Jul 12 13:28:02.533351 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 43/83] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:28:02 2022] GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944 => generated 1308 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:28:02.904120 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-f63da322-f18a-44cf-890f-f8615444d4d8 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:28:02.904747 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-f63da322-f18a-44cf-890f-f8615444d4d8 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 5d30ed54-909d-491f-a14c-bc4435cfdc6f] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:28:02.911638 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-f63da322-f18a-44cf-890f-f8615444d4d8 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:02.912327 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-f63da322-f18a-44cf-890f-f8615444d4d8 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:02.913301 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-f63da322-f18a-44cf-890f-f8615444d4d8 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:02.913773 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-f63da322-f18a-44cf-890f-f8615444d4d8 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:03.124271 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-f63da322-f18a-44cf-890f-f8615444d4d8 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:03.132266 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-f63da322-f18a-44cf-890f-f8615444d4d8 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:03.133789 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-f63da322-f18a-44cf-890f-f8615444d4d8 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:03.134890 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-f63da322-f18a-44cf-890f-f8615444d4d8 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f" status: 200 len: 1407 microversion: 2.20 time: 0.234729 Jul 12 13:28:03.135452 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 41/84] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:28:02 2022] GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f => generated 1407 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:28:03.173457 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-ac465fcf-aed5-42dd-abb2-a8b0e0de949e tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:28:03.174347 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-ac465fcf-aed5-42dd-abb2-a8b0e0de949e tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] [instance: fa6eab49-6809-41fa-96c5-a6297dbe51d6] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:28:03.180302 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-ac465fcf-aed5-42dd-abb2-a8b0e0de949e tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:03.180744 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-ac465fcf-aed5-42dd-abb2-a8b0e0de949e tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:03.181537 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-ac465fcf-aed5-42dd-abb2-a8b0e0de949e tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:03.181975 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-ac465fcf-aed5-42dd-abb2-a8b0e0de949e tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:03.243575 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-cd530718-47b7-4e6c-95eb-775b1845b415 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:28:03.244184 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-cd530718-47b7-4e6c-95eb-775b1845b415 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: 95edada5-d3ec-4056-99e9-379fb4b65394] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:28:03.262921 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-cd530718-47b7-4e6c-95eb-775b1845b415 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:03.263461 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-cd530718-47b7-4e6c-95eb-775b1845b415 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:03.264666 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-cd530718-47b7-4e6c-95eb-775b1845b415 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:03.265184 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-cd530718-47b7-4e6c-95eb-775b1845b415 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:03.279459 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-ac465fcf-aed5-42dd-abb2-a8b0e0de949e tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbc8ad40b44661b526511ecbc51027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd44719e63bb947bdb13e9309d1576521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:03.292709 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-ac465fcf-aed5-42dd-abb2-a8b0e0de949e tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] 10.222.0.23 "GET /compute/v2.1/servers/fa6eab49-6809-41fa-96c5-a6297dbe51d6" status: 200 len: 1267 microversion: 2.1 time: 0.123642 Jul 12 13:28:03.307248 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 44/85] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:28:03 2022] GET /compute/v2.1/servers/fa6eab49-6809-41fa-96c5-a6297dbe51d6 => generated 1267 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:28:03.494626 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-cd530718-47b7-4e6c-95eb-775b1845b415 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f448776d1074e22bfe6cfbe05e01db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27fe465e6743e19feec424e6e9f3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:03.504610 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-cd530718-47b7-4e6c-95eb-775b1845b415 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394" status: 200 len: 1225 microversion: 2.1 time: 0.264754 Jul 12 13:28:03.505494 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 42/86] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:28:03 2022] GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394 => generated 1225 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:28:03.549969 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-121cb784-cac7-4865-a3e1-9fa11cd671b8 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:28:03.550959 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-121cb784-cac7-4865-a3e1-9fa11cd671b8 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] [instance: eeb0b554-cd09-49b5-95f0-22fc7c707944] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:28:03.557904 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-121cb784-cac7-4865-a3e1-9fa11cd671b8 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:03.558362 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-121cb784-cac7-4865-a3e1-9fa11cd671b8 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:03.559348 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-121cb784-cac7-4865-a3e1-9fa11cd671b8 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:03.559972 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-121cb784-cac7-4865-a3e1-9fa11cd671b8 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:03.652224 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-121cb784-cac7-4865-a3e1-9fa11cd671b8 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b710bbdf0c4d58b4f3ee7ef7410c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8fca4ab6ed466a864c5551fea5f7ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:03.663985 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-121cb784-cac7-4865-a3e1-9fa11cd671b8 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] 10.222.0.23 "GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944" status: 200 len: 1296 microversion: 2.1 time: 0.117946 Jul 12 13:28:03.664951 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 45/87] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:28:03 2022] GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944 => generated 1296 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:28:04.153363 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-7c5ac0d0-85f3-4473-93ed-4de30ed3dc93 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:28:04.154015 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-7c5ac0d0-85f3-4473-93ed-4de30ed3dc93 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 5d30ed54-909d-491f-a14c-bc4435cfdc6f] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:28:04.163638 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-7c5ac0d0-85f3-4473-93ed-4de30ed3dc93 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:04.164378 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-7c5ac0d0-85f3-4473-93ed-4de30ed3dc93 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:04.168172 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-7c5ac0d0-85f3-4473-93ed-4de30ed3dc93 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:04.169064 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-7c5ac0d0-85f3-4473-93ed-4de30ed3dc93 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:04.324407 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-bbb64b4d-1bb4-4bcd-82c2-f8a4057a82c7 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:28:04.325022 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-bbb64b4d-1bb4-4bcd-82c2-f8a4057a82c7 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] [instance: fa6eab49-6809-41fa-96c5-a6297dbe51d6] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:28:04.336368 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-bbb64b4d-1bb4-4bcd-82c2-f8a4057a82c7 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:04.336832 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-bbb64b4d-1bb4-4bcd-82c2-f8a4057a82c7 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:04.341200 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-bbb64b4d-1bb4-4bcd-82c2-f8a4057a82c7 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:04.341801 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-bbb64b4d-1bb4-4bcd-82c2-f8a4057a82c7 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:04.533141 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-bbb64b4d-1bb4-4bcd-82c2-f8a4057a82c7 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbc8ad40b44661b526511ecbc51027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd44719e63bb947bdb13e9309d1576521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:04.563180 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-bbb64b4d-1bb4-4bcd-82c2-f8a4057a82c7 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] 10.222.0.23 "GET /compute/v2.1/servers/fa6eab49-6809-41fa-96c5-a6297dbe51d6" status: 200 len: 1273 microversion: 2.1 time: 0.241962 Jul 12 13:28:04.567126 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 46/88] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:28:04 2022] GET /compute/v2.1/servers/fa6eab49-6809-41fa-96c5-a6297dbe51d6 => generated 1273 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:28:04.582531 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-90b5815d-3091-4f4b-b484-0626d6278dfc tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:28:04.583741 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-90b5815d-3091-4f4b-b484-0626d6278dfc tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: 95edada5-d3ec-4056-99e9-379fb4b65394] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:28:04.613781 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-90b5815d-3091-4f4b-b484-0626d6278dfc tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:04.614694 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-90b5815d-3091-4f4b-b484-0626d6278dfc tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:04.620384 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-90b5815d-3091-4f4b-b484-0626d6278dfc tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:04.636093 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-90b5815d-3091-4f4b-b484-0626d6278dfc tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:05.104000 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-90b5815d-3091-4f4b-b484-0626d6278dfc tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f448776d1074e22bfe6cfbe05e01db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27fe465e6743e19feec424e6e9f3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:05.116440 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-90b5815d-3091-4f4b-b484-0626d6278dfc tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394" status: 200 len: 1273 microversion: 2.1 time: 0.547208 Jul 12 13:28:05.129155 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 47/89] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:28:04 2022] GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394 => generated 1273 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:28:05.134031 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-e5bb5e92-bfe8-4d24-af8e-390045a3cbb0 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:28:05.134655 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-e5bb5e92-bfe8-4d24-af8e-390045a3cbb0 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] [instance: eeb0b554-cd09-49b5-95f0-22fc7c707944] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:28:05.156453 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-e5bb5e92-bfe8-4d24-af8e-390045a3cbb0 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:05.158843 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-e5bb5e92-bfe8-4d24-af8e-390045a3cbb0 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:05.163280 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-e5bb5e92-bfe8-4d24-af8e-390045a3cbb0 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:05.163966 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-e5bb5e92-bfe8-4d24-af8e-390045a3cbb0 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:05.243012 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-7c5ac0d0-85f3-4473-93ed-4de30ed3dc93 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:05.284818 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-7c5ac0d0-85f3-4473-93ed-4de30ed3dc93 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:05.286475 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-7c5ac0d0-85f3-4473-93ed-4de30ed3dc93 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:05.287627 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-7c5ac0d0-85f3-4473-93ed-4de30ed3dc93 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f" status: 200 len: 1407 microversion: 2.20 time: 1.139004 Jul 12 13:28:05.296669 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 43/90] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:28:04 2022] GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f => generated 1407 bytes in 1148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:28:05.600191 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-9ac05669-1efe-4e1b-b0bd-744edff13cef tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:28:05.606378 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-9ac05669-1efe-4e1b-b0bd-744edff13cef tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] [instance: fa6eab49-6809-41fa-96c5-a6297dbe51d6] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:28:05.649893 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-9ac05669-1efe-4e1b-b0bd-744edff13cef tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:05.652257 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-9ac05669-1efe-4e1b-b0bd-744edff13cef tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:05.659215 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-9ac05669-1efe-4e1b-b0bd-744edff13cef tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:05.667038 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-9ac05669-1efe-4e1b-b0bd-744edff13cef tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:06.181906 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-e5bb5e92-bfe8-4d24-af8e-390045a3cbb0 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b710bbdf0c4d58b4f3ee7ef7410c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8fca4ab6ed466a864c5551fea5f7ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:06.200230 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-e5bb5e92-bfe8-4d24-af8e-390045a3cbb0 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] 10.222.0.23 "GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944" status: 200 len: 1363 microversion: 2.1 time: 1.069734 Jul 12 13:28:06.214533 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 48/91] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:28:05 2022] GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944 => generated 1363 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:28:06.221244 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-cc6c620d-e03a-45a8-94e3-c91025f6f0a0 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:28:06.222266 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-cc6c620d-e03a-45a8-94e3-c91025f6f0a0 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: 95edada5-d3ec-4056-99e9-379fb4b65394] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:28:06.230147 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-cc6c620d-e03a-45a8-94e3-c91025f6f0a0 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:06.230953 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-cc6c620d-e03a-45a8-94e3-c91025f6f0a0 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:06.231953 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-cc6c620d-e03a-45a8-94e3-c91025f6f0a0 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:06.233068 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-cc6c620d-e03a-45a8-94e3-c91025f6f0a0 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:06.559618 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-9ac05669-1efe-4e1b-b0bd-744edff13cef tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbc8ad40b44661b526511ecbc51027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd44719e63bb947bdb13e9309d1576521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:06.565084 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG dbcounter [-] [117987] Writing DB stats nova_cell1:SELECT=100 {{(pid=117987) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:06.571039 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-cc6c620d-e03a-45a8-94e3-c91025f6f0a0 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f448776d1074e22bfe6cfbe05e01db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27fe465e6743e19feec424e6e9f3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:06.581225 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-cc6c620d-e03a-45a8-94e3-c91025f6f0a0 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394" status: 200 len: 1279 microversion: 2.1 time: 0.365136 Jul 12 13:28:06.582021 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-9ac05669-1efe-4e1b-b0bd-744edff13cef tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] 10.222.0.23 "GET /compute/v2.1/servers/fa6eab49-6809-41fa-96c5-a6297dbe51d6" status: 200 len: 1315 microversion: 2.1 time: 0.999496 Jul 12 13:28:06.582450 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 49/92] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:28:06 2022] GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394 => generated 1279 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:28:06.589053 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-1167844b-08d9-46a1-9f92-b6038c932da0 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:28:06.589935 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-1167844b-08d9-46a1-9f92-b6038c932da0 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 5d30ed54-909d-491f-a14c-bc4435cfdc6f] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:28:06.592127 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 44/93] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:28:05 2022] GET /compute/v2.1/servers/fa6eab49-6809-41fa-96c5-a6297dbe51d6 => generated 1315 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:28:06.598145 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-1167844b-08d9-46a1-9f92-b6038c932da0 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:06.598841 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-1167844b-08d9-46a1-9f92-b6038c932da0 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:06.599757 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-1167844b-08d9-46a1-9f92-b6038c932da0 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:06.600333 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-1167844b-08d9-46a1-9f92-b6038c932da0 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:06.925600 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-1167844b-08d9-46a1-9f92-b6038c932da0 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:06.936644 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-1167844b-08d9-46a1-9f92-b6038c932da0 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:06.938517 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-1167844b-08d9-46a1-9f92-b6038c932da0 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:06.939749 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-1167844b-08d9-46a1-9f92-b6038c932da0 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f" status: 200 len: 1407 microversion: 2.20 time: 0.356076 Jul 12 13:28:06.940354 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 50/94] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:28:06 2022] GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f => generated 1407 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:28:07.222262 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-774b19bb-add1-4d55-a6f6-0287a4495c99 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:28:07.223083 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-774b19bb-add1-4d55-a6f6-0287a4495c99 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] [instance: eeb0b554-cd09-49b5-95f0-22fc7c707944] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:28:07.239479 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-774b19bb-add1-4d55-a6f6-0287a4495c99 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:07.240218 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-774b19bb-add1-4d55-a6f6-0287a4495c99 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:07.241227 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-774b19bb-add1-4d55-a6f6-0287a4495c99 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:07.241899 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-774b19bb-add1-4d55-a6f6-0287a4495c99 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:07.505710 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-774b19bb-add1-4d55-a6f6-0287a4495c99 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b710bbdf0c4d58b4f3ee7ef7410c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8fca4ab6ed466a864c5551fea5f7ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:07.522696 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-774b19bb-add1-4d55-a6f6-0287a4495c99 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] 10.222.0.23 "GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944" status: 200 len: 1363 microversion: 2.1 time: 0.304975 Jul 12 13:28:07.534521 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 45/95] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:28:07 2022] GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944 => generated 1363 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:28:07.602692 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-69ccb00f-3973-4d58-8cca-1c55bc770dfe tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:28:07.604283 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-69ccb00f-3973-4d58-8cca-1c55bc770dfe tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: 95edada5-d3ec-4056-99e9-379fb4b65394] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:28:07.619168 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-69ccb00f-3973-4d58-8cca-1c55bc770dfe tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:07.619607 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-69ccb00f-3973-4d58-8cca-1c55bc770dfe tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:07.620840 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-69ccb00f-3973-4d58-8cca-1c55bc770dfe tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:07.621495 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-69ccb00f-3973-4d58-8cca-1c55bc770dfe tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:07.621831 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [req-67671664-8833-4e5b-bd01-89494b6e3e37 req-a521de92-ceb1-4ee2-92a8-c9a8c982536b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf8dbed9-b15d-4daf-af11-7ee001424482", "tag": "e63ff95a-51aa-4e9d-85c0-b21397806ede"}]} {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:28:07.637207 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [req-67671664-8833-4e5b-bd01-89494b6e3e37 req-a521de92-ceb1-4ee2-92a8-c9a8c982536b service nova] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:07.637785 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [req-67671664-8833-4e5b-bd01-89494b6e3e37 req-a521de92-ceb1-4ee2-92a8-c9a8c982536b service nova] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:07.662435 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.compute.server_external_events [req-67671664-8833-4e5b-bd01-89494b6e3e37 req-a521de92-ceb1-4ee2-92a8-c9a8c982536b service nova] Creating event network-changed:e63ff95a-51aa-4e9d-85c0-b21397806ede for instance bf8dbed9-b15d-4daf-af11-7ee001424482 on hv-cinder-82002 Jul 12 13:28:07.663142 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [req-67671664-8833-4e5b-bd01-89494b6e3e37 req-a521de92-ceb1-4ee2-92a8-c9a8c982536b service nova] Acquired lock "compute-rpcapi-router" {{(pid=117988) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 12 13:28:07.664421 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-50133322-0252-425d-867b-a725ddbf5271 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:07.665080 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-50133322-0252-425d-867b-a725ddbf5271 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:07.666132 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-50133322-0252-425d-867b-a725ddbf5271 None None] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:07.666903 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-50133322-0252-425d-867b-a725ddbf5271 None None] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:07.678992 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.compute.rpcapi [None req-50133322-0252-425d-867b-a725ddbf5271 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 12 13:28:07.680236 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-50133322-0252-425d-867b-a725ddbf5271 None None] Releasing lock "compute-rpcapi-router" {{(pid=117988) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 12 13:28:07.716317 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-50133322-0252-425d-867b-a725ddbf5271 None None] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.207646 Jul 12 13:28:07.717846 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 51/96] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 12 13:28:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 13:28:07.726367 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-93bcad8c-a916-48bb-a1a8-f6ae30077614 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:28:07.727524 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-93bcad8c-a916-48bb-a1a8-f6ae30077614 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] [instance: fa6eab49-6809-41fa-96c5-a6297dbe51d6] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:28:07.736794 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-93bcad8c-a916-48bb-a1a8-f6ae30077614 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:07.738192 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-93bcad8c-a916-48bb-a1a8-f6ae30077614 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:07.739809 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-93bcad8c-a916-48bb-a1a8-f6ae30077614 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:07.740465 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-93bcad8c-a916-48bb-a1a8-f6ae30077614 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:07.763710 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-69ccb00f-3973-4d58-8cca-1c55bc770dfe tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f448776d1074e22bfe6cfbe05e01db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27fe465e6743e19feec424e6e9f3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:07.781649 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-69ccb00f-3973-4d58-8cca-1c55bc770dfe tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394" status: 200 len: 1279 microversion: 2.1 time: 0.184110 Jul 12 13:28:07.785305 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 46/97] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:28:07 2022] GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394 => generated 1279 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:28:07.832759 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [req-a70be26e-d575-42d3-a44b-edbb06f8f025 req-aaffe9df-df51-4d3f-aacc-56d6e0a6c279 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eeb0b554-cd09-49b5-95f0-22fc7c707944", "tag": "1611c489-7c46-47eb-9b57-cd5d00147d26"}]} {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:28:07.843081 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [req-a70be26e-d575-42d3-a44b-edbb06f8f025 req-aaffe9df-df51-4d3f-aacc-56d6e0a6c279 service nova] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:07.843615 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [req-a70be26e-d575-42d3-a44b-edbb06f8f025 req-aaffe9df-df51-4d3f-aacc-56d6e0a6c279 service nova] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:07.861013 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.compute.server_external_events [req-a70be26e-d575-42d3-a44b-edbb06f8f025 req-aaffe9df-df51-4d3f-aacc-56d6e0a6c279 service nova] Creating event network-changed:1611c489-7c46-47eb-9b57-cd5d00147d26 for instance eeb0b554-cd09-49b5-95f0-22fc7c707944 on hv-cinder-82002 Jul 12 13:28:07.866996 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [req-a70be26e-d575-42d3-a44b-edbb06f8f025 req-aaffe9df-df51-4d3f-aacc-56d6e0a6c279 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039470 Jul 12 13:28:07.868033 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 47/98] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 12 13:28:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:28:07.962747 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-822d6452-8d60-4f9e-8cf2-5a1448f736ee tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:28:07.968702 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-822d6452-8d60-4f9e-8cf2-5a1448f736ee tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 5d30ed54-909d-491f-a14c-bc4435cfdc6f] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:28:07.995359 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-822d6452-8d60-4f9e-8cf2-5a1448f736ee tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:07.996013 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-822d6452-8d60-4f9e-8cf2-5a1448f736ee tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:07.996924 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-822d6452-8d60-4f9e-8cf2-5a1448f736ee tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:07.997702 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-822d6452-8d60-4f9e-8cf2-5a1448f736ee tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:08.403159 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-93bcad8c-a916-48bb-a1a8-f6ae30077614 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbc8ad40b44661b526511ecbc51027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd44719e63bb947bdb13e9309d1576521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:08.415156 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-93bcad8c-a916-48bb-a1a8-f6ae30077614 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] 10.222.0.23 "GET /compute/v2.1/servers/fa6eab49-6809-41fa-96c5-a6297dbe51d6" status: 200 len: 1315 microversion: 2.1 time: 0.695397 Jul 12 13:28:08.416138 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 52/99] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:28:07 2022] GET /compute/v2.1/servers/fa6eab49-6809-41fa-96c5-a6297dbe51d6 => generated 1315 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:28:08.502318 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-822d6452-8d60-4f9e-8cf2-5a1448f736ee tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:08.515370 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-822d6452-8d60-4f9e-8cf2-5a1448f736ee tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:08.517785 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-822d6452-8d60-4f9e-8cf2-5a1448f736ee tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:08.519697 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-822d6452-8d60-4f9e-8cf2-5a1448f736ee tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f" status: 200 len: 1407 microversion: 2.20 time: 0.561010 Jul 12 13:28:08.520663 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 48/100] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:28:07 2022] GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f => generated 1407 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:28:08.541209 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-c8d1ac95-6f65-4183-891b-06bbb370c004 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:28:08.543292 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-c8d1ac95-6f65-4183-891b-06bbb370c004 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] [instance: eeb0b554-cd09-49b5-95f0-22fc7c707944] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:28:08.551594 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-c8d1ac95-6f65-4183-891b-06bbb370c004 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:08.552036 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-c8d1ac95-6f65-4183-891b-06bbb370c004 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:08.552800 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-c8d1ac95-6f65-4183-891b-06bbb370c004 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:08.553232 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-c8d1ac95-6f65-4183-891b-06bbb370c004 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:08.808378 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-43168a8c-e413-419a-a3ec-191a30535a98 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:28:08.809152 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-43168a8c-e413-419a-a3ec-191a30535a98 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: 95edada5-d3ec-4056-99e9-379fb4b65394] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:28:08.810030 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-c8d1ac95-6f65-4183-891b-06bbb370c004 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b710bbdf0c4d58b4f3ee7ef7410c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8fca4ab6ed466a864c5551fea5f7ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:08.835201 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-43168a8c-e413-419a-a3ec-191a30535a98 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:08.836958 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-43168a8c-e413-419a-a3ec-191a30535a98 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:08.838401 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-43168a8c-e413-419a-a3ec-191a30535a98 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:08.839174 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-43168a8c-e413-419a-a3ec-191a30535a98 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:08.844381 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-c8d1ac95-6f65-4183-891b-06bbb370c004 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] 10.222.0.23 "GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944" status: 200 len: 1363 microversion: 2.1 time: 0.301983 Jul 12 13:28:08.846798 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 53/101] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:28:08 2022] GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944 => generated 1363 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:28:09.019412 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-43168a8c-e413-419a-a3ec-191a30535a98 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f448776d1074e22bfe6cfbe05e01db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27fe465e6743e19feec424e6e9f3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:09.027800 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-43168a8c-e413-419a-a3ec-191a30535a98 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394" status: 200 len: 1321 microversion: 2.1 time: 0.227167 Jul 12 13:28:09.033494 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 49/102] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:28:08 2022] GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394 => generated 1321 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:28:09.434984 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-f7348dc7-fe4a-4d6f-8150-0f4404731a80 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:28:09.436218 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-f7348dc7-fe4a-4d6f-8150-0f4404731a80 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] [instance: fa6eab49-6809-41fa-96c5-a6297dbe51d6] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:28:09.444696 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-f7348dc7-fe4a-4d6f-8150-0f4404731a80 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:09.445355 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-f7348dc7-fe4a-4d6f-8150-0f4404731a80 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:09.446216 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-f7348dc7-fe4a-4d6f-8150-0f4404731a80 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:09.446719 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-f7348dc7-fe4a-4d6f-8150-0f4404731a80 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:09.541640 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-4e005a79-0611-4413-ad8a-7dc16992e18e tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:28:09.542913 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-4e005a79-0611-4413-ad8a-7dc16992e18e tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 5d30ed54-909d-491f-a14c-bc4435cfdc6f] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:28:09.556320 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-4e005a79-0611-4413-ad8a-7dc16992e18e tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:09.556775 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-4e005a79-0611-4413-ad8a-7dc16992e18e tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:09.559326 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-4e005a79-0611-4413-ad8a-7dc16992e18e tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:09.560039 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-4e005a79-0611-4413-ad8a-7dc16992e18e tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:09.653572 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-f7348dc7-fe4a-4d6f-8150-0f4404731a80 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbc8ad40b44661b526511ecbc51027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd44719e63bb947bdb13e9309d1576521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:09.662432 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-f7348dc7-fe4a-4d6f-8150-0f4404731a80 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] 10.222.0.23 "GET /compute/v2.1/servers/fa6eab49-6809-41fa-96c5-a6297dbe51d6" status: 200 len: 1315 microversion: 2.1 time: 0.233025 Jul 12 13:28:09.663664 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 54/103] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:28:09 2022] GET /compute/v2.1/servers/fa6eab49-6809-41fa-96c5-a6297dbe51d6 => generated 1315 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:28:09.736647 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-4e005a79-0611-4413-ad8a-7dc16992e18e tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:09.745230 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-4e005a79-0611-4413-ad8a-7dc16992e18e tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:09.746986 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-4e005a79-0611-4413-ad8a-7dc16992e18e tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:09.748287 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-4e005a79-0611-4413-ad8a-7dc16992e18e tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f" status: 200 len: 1407 microversion: 2.20 time: 0.213826 Jul 12 13:28:09.760342 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 50/104] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:28:09 2022] GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f => generated 1407 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:28:09.863124 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-0faa2991-66f1-4806-beb1-30819471035d tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:28:09.864305 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-0faa2991-66f1-4806-beb1-30819471035d tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] [instance: eeb0b554-cd09-49b5-95f0-22fc7c707944] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:28:09.870823 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-0faa2991-66f1-4806-beb1-30819471035d tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:09.871270 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-0faa2991-66f1-4806-beb1-30819471035d tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:09.872302 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-0faa2991-66f1-4806-beb1-30819471035d tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:09.872740 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-0faa2991-66f1-4806-beb1-30819471035d tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:10.029549 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-0faa2991-66f1-4806-beb1-30819471035d tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b710bbdf0c4d58b4f3ee7ef7410c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8fca4ab6ed466a864c5551fea5f7ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:10.042792 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-0faa2991-66f1-4806-beb1-30819471035d tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] 10.222.0.23 "GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944" status: 200 len: 1363 microversion: 2.1 time: 0.180828 Jul 12 13:28:10.045904 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 55/105] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:28:09 2022] GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944 => generated 1363 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:28:10.050630 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-fed7c2f5-34c0-4aa2-b936-84eec243764d tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:28:10.052187 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-fed7c2f5-34c0-4aa2-b936-84eec243764d tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: 95edada5-d3ec-4056-99e9-379fb4b65394] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:28:10.058987 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-fed7c2f5-34c0-4aa2-b936-84eec243764d tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:10.059677 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-fed7c2f5-34c0-4aa2-b936-84eec243764d tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:10.060632 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-fed7c2f5-34c0-4aa2-b936-84eec243764d tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:10.061328 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-fed7c2f5-34c0-4aa2-b936-84eec243764d tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:10.294073 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-fed7c2f5-34c0-4aa2-b936-84eec243764d tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f448776d1074e22bfe6cfbe05e01db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27fe465e6743e19feec424e6e9f3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:10.315362 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-fed7c2f5-34c0-4aa2-b936-84eec243764d tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394" status: 200 len: 1321 microversion: 2.1 time: 0.269162 Jul 12 13:28:10.316309 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 51/106] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:28:10 2022] GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394 => generated 1321 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:28:10.680813 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-11cc5458-2afb-4370-bcb8-4f28d341e462 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:28:10.681445 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-11cc5458-2afb-4370-bcb8-4f28d341e462 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] [instance: fa6eab49-6809-41fa-96c5-a6297dbe51d6] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:28:10.692500 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-11cc5458-2afb-4370-bcb8-4f28d341e462 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:10.693015 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-11cc5458-2afb-4370-bcb8-4f28d341e462 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:10.693828 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-11cc5458-2afb-4370-bcb8-4f28d341e462 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:10.694266 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-11cc5458-2afb-4370-bcb8-4f28d341e462 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:10.769550 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-fb87f9c6-3fc2-4f36-a18f-a88f0aa8a4e9 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:28:10.770527 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-fb87f9c6-3fc2-4f36-a18f-a88f0aa8a4e9 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 5d30ed54-909d-491f-a14c-bc4435cfdc6f] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:28:10.788383 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-fb87f9c6-3fc2-4f36-a18f-a88f0aa8a4e9 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:10.788835 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-fb87f9c6-3fc2-4f36-a18f-a88f0aa8a4e9 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:10.789884 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-fb87f9c6-3fc2-4f36-a18f-a88f0aa8a4e9 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:10.790629 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-fb87f9c6-3fc2-4f36-a18f-a88f0aa8a4e9 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:11.046129 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-11cc5458-2afb-4370-bcb8-4f28d341e462 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbc8ad40b44661b526511ecbc51027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd44719e63bb947bdb13e9309d1576521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:11.058986 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-11cc5458-2afb-4370-bcb8-4f28d341e462 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] 10.222.0.23 "GET /compute/v2.1/servers/fa6eab49-6809-41fa-96c5-a6297dbe51d6" status: 200 len: 1315 microversion: 2.1 time: 0.383198 Jul 12 13:28:11.059832 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 56/107] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:28:10 2022] GET /compute/v2.1/servers/fa6eab49-6809-41fa-96c5-a6297dbe51d6 => generated 1315 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:28:11.066287 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-fc8c99cf-4abb-4de1-b9a8-bc4192ff08d7 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:28:11.067177 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-fc8c99cf-4abb-4de1-b9a8-bc4192ff08d7 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] [instance: eeb0b554-cd09-49b5-95f0-22fc7c707944] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:28:11.074745 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-fc8c99cf-4abb-4de1-b9a8-bc4192ff08d7 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:11.075559 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-fc8c99cf-4abb-4de1-b9a8-bc4192ff08d7 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:11.076804 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-fc8c99cf-4abb-4de1-b9a8-bc4192ff08d7 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:11.077589 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-fc8c99cf-4abb-4de1-b9a8-bc4192ff08d7 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:11.093082 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-fb87f9c6-3fc2-4f36-a18f-a88f0aa8a4e9 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:11.108135 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-fb87f9c6-3fc2-4f36-a18f-a88f0aa8a4e9 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:11.110636 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-fb87f9c6-3fc2-4f36-a18f-a88f0aa8a4e9 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:11.112781 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-fb87f9c6-3fc2-4f36-a18f-a88f0aa8a4e9 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f" status: 200 len: 1407 microversion: 2.20 time: 0.349012 Jul 12 13:28:11.115638 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 52/108] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:28:10 2022] GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f => generated 1407 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:28:11.223564 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [req-e81b4aba-ff35-42a9-8bac-99d5fbcfcb4f req-58b6148a-4ea3-4576-8556-d4e149d7836d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa6eab49-6809-41fa-96c5-a6297dbe51d6", "tag": "1ae19672-01e9-412a-846d-c5a3eb239196"}]} {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:28:11.234461 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [req-e81b4aba-ff35-42a9-8bac-99d5fbcfcb4f req-58b6148a-4ea3-4576-8556-d4e149d7836d service nova] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:11.234619 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [req-e81b4aba-ff35-42a9-8bac-99d5fbcfcb4f req-58b6148a-4ea3-4576-8556-d4e149d7836d service nova] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:11.261311 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.compute.server_external_events [req-e81b4aba-ff35-42a9-8bac-99d5fbcfcb4f req-58b6148a-4ea3-4576-8556-d4e149d7836d service nova] Creating event network-changed:1ae19672-01e9-412a-846d-c5a3eb239196 for instance fa6eab49-6809-41fa-96c5-a6297dbe51d6 on hv-cinder-82002 Jul 12 13:28:11.279458 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [req-e81b4aba-ff35-42a9-8bac-99d5fbcfcb4f req-58b6148a-4ea3-4576-8556-d4e149d7836d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059583 Jul 12 13:28:11.281361 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 53/109] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 12 13:28:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 13:28:11.334149 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-ddc53862-f84f-4a9d-a50d-fa2217679732 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:28:11.335435 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-ddc53862-f84f-4a9d-a50d-fa2217679732 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: 95edada5-d3ec-4056-99e9-379fb4b65394] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:28:11.356589 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-ddc53862-f84f-4a9d-a50d-fa2217679732 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:11.357215 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-ddc53862-f84f-4a9d-a50d-fa2217679732 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:11.362108 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-ddc53862-f84f-4a9d-a50d-fa2217679732 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:11.362734 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-ddc53862-f84f-4a9d-a50d-fa2217679732 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:11.379692 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-fc8c99cf-4abb-4de1-b9a8-bc4192ff08d7 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b710bbdf0c4d58b4f3ee7ef7410c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8fca4ab6ed466a864c5551fea5f7ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:11.393063 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-fc8c99cf-4abb-4de1-b9a8-bc4192ff08d7 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] 10.222.0.23 "GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944" status: 200 len: 1363 microversion: 2.1 time: 0.331831 Jul 12 13:28:11.403432 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 57/110] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:28:11 2022] GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944 => generated 1363 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:28:11.604262 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-ddc53862-f84f-4a9d-a50d-fa2217679732 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f448776d1074e22bfe6cfbe05e01db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27fe465e6743e19feec424e6e9f3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:11.620180 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-ddc53862-f84f-4a9d-a50d-fa2217679732 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394" status: 200 len: 1321 microversion: 2.1 time: 0.291241 Jul 12 13:28:11.630424 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 54/111] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:28:11 2022] GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394 => generated 1321 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:28:12.084436 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-abfb1a1d-9f18-4166-aafb-7ab9e128135a tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:28:12.084436 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-abfb1a1d-9f18-4166-aafb-7ab9e128135a tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] [instance: fa6eab49-6809-41fa-96c5-a6297dbe51d6] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:28:12.088827 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-abfb1a1d-9f18-4166-aafb-7ab9e128135a tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:12.089284 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-abfb1a1d-9f18-4166-aafb-7ab9e128135a tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:12.090092 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-abfb1a1d-9f18-4166-aafb-7ab9e128135a tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:12.090528 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-abfb1a1d-9f18-4166-aafb-7ab9e128135a tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:12.133797 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-336878ac-36be-41db-82dc-88a3a5bf00c7 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:28:12.134414 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-336878ac-36be-41db-82dc-88a3a5bf00c7 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 5d30ed54-909d-491f-a14c-bc4435cfdc6f] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:28:12.142860 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-336878ac-36be-41db-82dc-88a3a5bf00c7 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:12.143258 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-336878ac-36be-41db-82dc-88a3a5bf00c7 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:12.144117 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-336878ac-36be-41db-82dc-88a3a5bf00c7 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:12.144592 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-336878ac-36be-41db-82dc-88a3a5bf00c7 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:12.363191 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-abfb1a1d-9f18-4166-aafb-7ab9e128135a tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbc8ad40b44661b526511ecbc51027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd44719e63bb947bdb13e9309d1576521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:12.379658 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-abfb1a1d-9f18-4166-aafb-7ab9e128135a tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] 10.222.0.23 "GET /compute/v2.1/servers/fa6eab49-6809-41fa-96c5-a6297dbe51d6" status: 200 len: 1315 microversion: 2.1 time: 0.306723 Jul 12 13:28:12.380583 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 58/112] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:28:12 2022] GET /compute/v2.1/servers/fa6eab49-6809-41fa-96c5-a6297dbe51d6 => generated 1315 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:28:12.402094 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-336878ac-36be-41db-82dc-88a3a5bf00c7 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:12.412032 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-73f74c64-fd47-431c-8332-2bf9b3245f75 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:28:12.412670 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-73f74c64-fd47-431c-8332-2bf9b3245f75 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] [instance: eeb0b554-cd09-49b5-95f0-22fc7c707944] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:28:12.414653 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-336878ac-36be-41db-82dc-88a3a5bf00c7 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:12.416341 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-336878ac-36be-41db-82dc-88a3a5bf00c7 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:12.417825 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-336878ac-36be-41db-82dc-88a3a5bf00c7 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f" status: 200 len: 1407 microversion: 2.20 time: 0.288096 Jul 12 13:28:12.418478 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 55/113] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:28:12 2022] GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f => generated 1407 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 13:28:12.429610 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-73f74c64-fd47-431c-8332-2bf9b3245f75 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:12.430271 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-73f74c64-fd47-431c-8332-2bf9b3245f75 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:12.431692 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-73f74c64-fd47-431c-8332-2bf9b3245f75 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:12.432356 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-73f74c64-fd47-431c-8332-2bf9b3245f75 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:12.440447 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG dbcounter [-] [117988] Writing DB stats nova_cell1:SELECT=100 {{(pid=117988) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:12.592646 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-73f74c64-fd47-431c-8332-2bf9b3245f75 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b710bbdf0c4d58b4f3ee7ef7410c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8fca4ab6ed466a864c5551fea5f7ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:12.606233 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-73f74c64-fd47-431c-8332-2bf9b3245f75 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] 10.222.0.23 "GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944" status: 200 len: 1363 microversion: 2.1 time: 0.196581 Jul 12 13:28:12.607217 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 59/114] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:28:12 2022] GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944 => generated 1363 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:28:12.647053 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-c10239c1-6d77-4e05-8281-36c559941ad1 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:28:12.647853 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-c10239c1-6d77-4e05-8281-36c559941ad1 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: 95edada5-d3ec-4056-99e9-379fb4b65394] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:28:12.653962 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-c10239c1-6d77-4e05-8281-36c559941ad1 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:12.654412 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-c10239c1-6d77-4e05-8281-36c559941ad1 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:12.655166 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-c10239c1-6d77-4e05-8281-36c559941ad1 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:12.655599 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-c10239c1-6d77-4e05-8281-36c559941ad1 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:12.805973 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-c10239c1-6d77-4e05-8281-36c559941ad1 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f448776d1074e22bfe6cfbe05e01db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27fe465e6743e19feec424e6e9f3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:12.818772 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-c10239c1-6d77-4e05-8281-36c559941ad1 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394" status: 200 len: 1321 microversion: 2.1 time: 0.176029 Jul 12 13:28:12.819739 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 56/115] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:28:12 2022] GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394 => generated 1321 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:28:13.408640 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-9ae14eb6-9622-46e4-abb1-f2c83de034bb tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:28:13.409360 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-9ae14eb6-9622-46e4-abb1-f2c83de034bb tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] [instance: fa6eab49-6809-41fa-96c5-a6297dbe51d6] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:28:13.424257 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-9ae14eb6-9622-46e4-abb1-f2c83de034bb tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:13.427651 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-9ae14eb6-9622-46e4-abb1-f2c83de034bb tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:13.429497 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-9ae14eb6-9622-46e4-abb1-f2c83de034bb tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:13.430106 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-9ae14eb6-9622-46e4-abb1-f2c83de034bb tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:13.437276 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-3a6e7a04-c50c-4dad-bcd2-289ab52f15f1 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:28:13.440069 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-3a6e7a04-c50c-4dad-bcd2-289ab52f15f1 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 5d30ed54-909d-491f-a14c-bc4435cfdc6f] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:28:13.450136 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-3a6e7a04-c50c-4dad-bcd2-289ab52f15f1 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:13.452127 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-3a6e7a04-c50c-4dad-bcd2-289ab52f15f1 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:13.453119 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-3a6e7a04-c50c-4dad-bcd2-289ab52f15f1 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:13.457335 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-3a6e7a04-c50c-4dad-bcd2-289ab52f15f1 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:13.706915 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-9ae14eb6-9622-46e4-abb1-f2c83de034bb tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbc8ad40b44661b526511ecbc51027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd44719e63bb947bdb13e9309d1576521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:13.719188 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-9ae14eb6-9622-46e4-abb1-f2c83de034bb tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] 10.222.0.23 "GET /compute/v2.1/servers/fa6eab49-6809-41fa-96c5-a6297dbe51d6" status: 200 len: 1315 microversion: 2.1 time: 0.312633 Jul 12 13:28:13.731662 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 60/116] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:28:13 2022] GET /compute/v2.1/servers/fa6eab49-6809-41fa-96c5-a6297dbe51d6 => generated 1315 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:28:13.744990 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-9eb56ff3-7fb2-4b86-bc67-a09202fffaa1 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:28:13.746140 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-9eb56ff3-7fb2-4b86-bc67-a09202fffaa1 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] [instance: eeb0b554-cd09-49b5-95f0-22fc7c707944] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:28:13.758532 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-9eb56ff3-7fb2-4b86-bc67-a09202fffaa1 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:13.759406 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-9eb56ff3-7fb2-4b86-bc67-a09202fffaa1 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:13.760509 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-9eb56ff3-7fb2-4b86-bc67-a09202fffaa1 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:13.761338 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-9eb56ff3-7fb2-4b86-bc67-a09202fffaa1 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:13.806073 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-3a6e7a04-c50c-4dad-bcd2-289ab52f15f1 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:13.825322 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-3a6e7a04-c50c-4dad-bcd2-289ab52f15f1 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:13.833119 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-3a6e7a04-c50c-4dad-bcd2-289ab52f15f1 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:13.837497 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-3a6e7a04-c50c-4dad-bcd2-289ab52f15f1 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f" status: 200 len: 1407 microversion: 2.20 time: 0.402000 Jul 12 13:28:13.838299 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 57/117] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:28:13 2022] GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f => generated 1407 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:28:13.844829 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-5fbf0bc3-c9ba-4947-a149-4c82766b8257 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:28:13.847656 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-5fbf0bc3-c9ba-4947-a149-4c82766b8257 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: 95edada5-d3ec-4056-99e9-379fb4b65394] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:28:13.862746 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-5fbf0bc3-c9ba-4947-a149-4c82766b8257 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:13.863190 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-5fbf0bc3-c9ba-4947-a149-4c82766b8257 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:13.864139 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-5fbf0bc3-c9ba-4947-a149-4c82766b8257 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:13.864567 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-5fbf0bc3-c9ba-4947-a149-4c82766b8257 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:14.085952 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-9eb56ff3-7fb2-4b86-bc67-a09202fffaa1 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b710bbdf0c4d58b4f3ee7ef7410c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8fca4ab6ed466a864c5551fea5f7ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:14.101931 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-9eb56ff3-7fb2-4b86-bc67-a09202fffaa1 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] 10.222.0.23 "GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944" status: 200 len: 1363 microversion: 2.1 time: 0.367545 Jul 12 13:28:14.103302 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 61/118] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:28:13 2022] GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944 => generated 1363 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:28:14.105878 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-5fbf0bc3-c9ba-4947-a149-4c82766b8257 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f448776d1074e22bfe6cfbe05e01db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27fe465e6743e19feec424e6e9f3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:14.120306 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-5fbf0bc3-c9ba-4947-a149-4c82766b8257 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394" status: 200 len: 1321 microversion: 2.1 time: 0.280235 Jul 12 13:28:14.121619 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 58/119] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:28:13 2022] GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394 => generated 1321 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:28:14.661846 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [req-a8b7c9f3-bda4-4223-9211-13a0c6739c4f req-ec64a729-ff68-4662-a25a-f8ddd69e8417 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95edada5-d3ec-4056-99e9-379fb4b65394", "tag": "46dc7639-cc9b-48c0-9d26-acdc89e2058e"}]} {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:28:14.681719 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [req-a8b7c9f3-bda4-4223-9211-13a0c6739c4f req-ec64a729-ff68-4662-a25a-f8ddd69e8417 service nova] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:14.682547 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [req-a8b7c9f3-bda4-4223-9211-13a0c6739c4f req-ec64a729-ff68-4662-a25a-f8ddd69e8417 service nova] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:14.707924 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.compute.server_external_events [req-a8b7c9f3-bda4-4223-9211-13a0c6739c4f req-ec64a729-ff68-4662-a25a-f8ddd69e8417 service nova] Creating event network-changed:46dc7639-cc9b-48c0-9d26-acdc89e2058e for instance 95edada5-d3ec-4056-99e9-379fb4b65394 on hv-cinder-82002 Jul 12 13:28:14.718663 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [req-a8b7c9f3-bda4-4223-9211-13a0c6739c4f req-ec64a729-ff68-4662-a25a-f8ddd69e8417 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108231 Jul 12 13:28:14.720017 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 62/120] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 12 13:28:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:28:14.743795 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-23f25d51-da5e-4035-a137-8b02ccd5eb97 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:28:14.746568 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-23f25d51-da5e-4035-a137-8b02ccd5eb97 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] [instance: fa6eab49-6809-41fa-96c5-a6297dbe51d6] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:28:14.759057 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-23f25d51-da5e-4035-a137-8b02ccd5eb97 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:14.759799 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-23f25d51-da5e-4035-a137-8b02ccd5eb97 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:14.761333 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-23f25d51-da5e-4035-a137-8b02ccd5eb97 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:14.762101 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-23f25d51-da5e-4035-a137-8b02ccd5eb97 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:14.872516 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-bea672b3-d9a7-408c-8d2b-7b4cb6f2ffde tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:28:14.874127 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-bea672b3-d9a7-408c-8d2b-7b4cb6f2ffde tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 5d30ed54-909d-491f-a14c-bc4435cfdc6f] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:28:14.887698 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-bea672b3-d9a7-408c-8d2b-7b4cb6f2ffde tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:14.889366 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-bea672b3-d9a7-408c-8d2b-7b4cb6f2ffde tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:14.892937 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-bea672b3-d9a7-408c-8d2b-7b4cb6f2ffde tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:14.894088 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-bea672b3-d9a7-408c-8d2b-7b4cb6f2ffde tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:15.160912 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-23f25d51-da5e-4035-a137-8b02ccd5eb97 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbc8ad40b44661b526511ecbc51027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd44719e63bb947bdb13e9309d1576521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:15.176436 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-23f25d51-da5e-4035-a137-8b02ccd5eb97 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] 10.222.0.23 "GET /compute/v2.1/servers/fa6eab49-6809-41fa-96c5-a6297dbe51d6" status: 200 len: 1315 microversion: 2.1 time: 0.440597 Jul 12 13:28:15.178176 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 59/121] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:28:14 2022] GET /compute/v2.1/servers/fa6eab49-6809-41fa-96c5-a6297dbe51d6 => generated 1315 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:28:15.186053 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-94a2b359-d19c-41b1-9234-5b0b08cd217c tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:28:15.187689 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-94a2b359-d19c-41b1-9234-5b0b08cd217c tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] [instance: eeb0b554-cd09-49b5-95f0-22fc7c707944] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:28:15.199115 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-94a2b359-d19c-41b1-9234-5b0b08cd217c tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:15.199938 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-94a2b359-d19c-41b1-9234-5b0b08cd217c tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:15.201370 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-94a2b359-d19c-41b1-9234-5b0b08cd217c tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:15.202018 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-94a2b359-d19c-41b1-9234-5b0b08cd217c tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:15.213939 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-bea672b3-d9a7-408c-8d2b-7b4cb6f2ffde tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:15.228075 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-bea672b3-d9a7-408c-8d2b-7b4cb6f2ffde tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:15.231085 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-bea672b3-d9a7-408c-8d2b-7b4cb6f2ffde tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:15.233020 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-bea672b3-d9a7-408c-8d2b-7b4cb6f2ffde tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f" status: 200 len: 1407 microversion: 2.20 time: 0.372128 Jul 12 13:28:15.242645 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 63/122] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:28:14 2022] GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f => generated 1407 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 13:28:15.251392 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-94af3ce2-8ab6-4514-9d3d-9ec5758f3da7 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:28:15.253000 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-94af3ce2-8ab6-4514-9d3d-9ec5758f3da7 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: 95edada5-d3ec-4056-99e9-379fb4b65394] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:28:15.262679 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-94af3ce2-8ab6-4514-9d3d-9ec5758f3da7 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:15.263355 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-94af3ce2-8ab6-4514-9d3d-9ec5758f3da7 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:15.264166 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-94af3ce2-8ab6-4514-9d3d-9ec5758f3da7 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:15.264612 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-94af3ce2-8ab6-4514-9d3d-9ec5758f3da7 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:15.416973 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-94a2b359-d19c-41b1-9234-5b0b08cd217c tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b710bbdf0c4d58b4f3ee7ef7410c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8fca4ab6ed466a864c5551fea5f7ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:15.426031 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-94a2b359-d19c-41b1-9234-5b0b08cd217c tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] 10.222.0.23 "GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944" status: 200 len: 1363 microversion: 2.1 time: 0.246317 Jul 12 13:28:15.426866 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 60/123] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:28:15 2022] GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944 => generated 1363 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:28:15.467028 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-94af3ce2-8ab6-4514-9d3d-9ec5758f3da7 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f448776d1074e22bfe6cfbe05e01db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27fe465e6743e19feec424e6e9f3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:15.475252 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-94af3ce2-8ab6-4514-9d3d-9ec5758f3da7 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394" status: 200 len: 1321 microversion: 2.1 time: 0.236554 Jul 12 13:28:15.476051 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 64/124] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:28:15 2022] GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394 => generated 1321 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:28:16.196061 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-d0d5107f-e532-46ba-b330-57e278738ed6 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:28:16.196678 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-d0d5107f-e532-46ba-b330-57e278738ed6 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] [instance: fa6eab49-6809-41fa-96c5-a6297dbe51d6] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:28:16.202719 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-d0d5107f-e532-46ba-b330-57e278738ed6 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:16.203224 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-d0d5107f-e532-46ba-b330-57e278738ed6 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:16.204150 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-d0d5107f-e532-46ba-b330-57e278738ed6 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:16.204614 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-d0d5107f-e532-46ba-b330-57e278738ed6 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:16.262829 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-7b18822d-5ce2-48d1-ae90-26839a9bc456 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:28:16.263533 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-7b18822d-5ce2-48d1-ae90-26839a9bc456 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 5d30ed54-909d-491f-a14c-bc4435cfdc6f] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:28:16.271328 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-7b18822d-5ce2-48d1-ae90-26839a9bc456 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:16.271866 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-7b18822d-5ce2-48d1-ae90-26839a9bc456 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:16.272738 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-7b18822d-5ce2-48d1-ae90-26839a9bc456 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:16.273237 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-7b18822d-5ce2-48d1-ae90-26839a9bc456 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:16.383312 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-d0d5107f-e532-46ba-b330-57e278738ed6 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbc8ad40b44661b526511ecbc51027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd44719e63bb947bdb13e9309d1576521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:16.392703 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-d0d5107f-e532-46ba-b330-57e278738ed6 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] 10.222.0.23 "GET /compute/v2.1/servers/fa6eab49-6809-41fa-96c5-a6297dbe51d6" status: 200 len: 1315 microversion: 2.1 time: 0.200538 Jul 12 13:28:16.393370 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 61/125] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:28:16 2022] GET /compute/v2.1/servers/fa6eab49-6809-41fa-96c5-a6297dbe51d6 => generated 1315 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:28:16.451287 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-07691b18-3bd8-4a39-9039-3f99e43923ee tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:28:16.452649 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-07691b18-3bd8-4a39-9039-3f99e43923ee tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] [instance: eeb0b554-cd09-49b5-95f0-22fc7c707944] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:28:16.461212 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-07691b18-3bd8-4a39-9039-3f99e43923ee tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:16.461692 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-07691b18-3bd8-4a39-9039-3f99e43923ee tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:16.462473 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-07691b18-3bd8-4a39-9039-3f99e43923ee tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:16.462904 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-07691b18-3bd8-4a39-9039-3f99e43923ee tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:16.465295 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-7b18822d-5ce2-48d1-ae90-26839a9bc456 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:16.479768 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-7b18822d-5ce2-48d1-ae90-26839a9bc456 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:16.482736 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-7b18822d-5ce2-48d1-ae90-26839a9bc456 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:16.484757 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-7b18822d-5ce2-48d1-ae90-26839a9bc456 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f" status: 200 len: 1407 microversion: 2.20 time: 0.225806 Jul 12 13:28:16.486540 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 65/126] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:28:16 2022] GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f => generated 1407 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:28:16.495543 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-ab75e168-9dd5-4f0f-b809-cbee18b2bb4b tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:28:16.496436 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-ab75e168-9dd5-4f0f-b809-cbee18b2bb4b tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: 95edada5-d3ec-4056-99e9-379fb4b65394] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:28:16.504537 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-ab75e168-9dd5-4f0f-b809-cbee18b2bb4b tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:16.504986 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-ab75e168-9dd5-4f0f-b809-cbee18b2bb4b tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:16.505810 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-ab75e168-9dd5-4f0f-b809-cbee18b2bb4b tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:16.506290 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-ab75e168-9dd5-4f0f-b809-cbee18b2bb4b tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:16.713985 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-07691b18-3bd8-4a39-9039-3f99e43923ee tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b710bbdf0c4d58b4f3ee7ef7410c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8fca4ab6ed466a864c5551fea5f7ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:16.717864 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG dbcounter [-] [117987] Writing DB stats nova_cell1:SELECT=100 {{(pid=117987) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:16.726490 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-07691b18-3bd8-4a39-9039-3f99e43923ee tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] 10.222.0.23 "GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944" status: 200 len: 1363 microversion: 2.1 time: 0.283689 Jul 12 13:28:16.727784 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 62/127] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:28:16 2022] GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944 => generated 1363 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:28:16.732245 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-ab75e168-9dd5-4f0f-b809-cbee18b2bb4b tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f448776d1074e22bfe6cfbe05e01db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27fe465e6743e19feec424e6e9f3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:16.743698 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-ab75e168-9dd5-4f0f-b809-cbee18b2bb4b tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394" status: 200 len: 1321 microversion: 2.1 time: 0.254150 Jul 12 13:28:16.744293 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 66/128] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:28:16 2022] GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394 => generated 1321 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:28:17.409703 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-f5906c42-b1f5-4b2f-aee4-f6e3c58fca31 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:28:17.410308 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-f5906c42-b1f5-4b2f-aee4-f6e3c58fca31 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] [instance: fa6eab49-6809-41fa-96c5-a6297dbe51d6] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:28:17.416968 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-f5906c42-b1f5-4b2f-aee4-f6e3c58fca31 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:17.417452 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-f5906c42-b1f5-4b2f-aee4-f6e3c58fca31 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:17.418215 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-f5906c42-b1f5-4b2f-aee4-f6e3c58fca31 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:17.418648 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-f5906c42-b1f5-4b2f-aee4-f6e3c58fca31 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:17.504668 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-79e02f67-ca20-4d14-87c3-618b33749bae tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:28:17.505270 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-79e02f67-ca20-4d14-87c3-618b33749bae tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 5d30ed54-909d-491f-a14c-bc4435cfdc6f] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:28:17.511393 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-79e02f67-ca20-4d14-87c3-618b33749bae tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:17.511834 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-79e02f67-ca20-4d14-87c3-618b33749bae tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:17.512590 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-79e02f67-ca20-4d14-87c3-618b33749bae tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:17.513023 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-79e02f67-ca20-4d14-87c3-618b33749bae tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:17.562132 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-f5906c42-b1f5-4b2f-aee4-f6e3c58fca31 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbc8ad40b44661b526511ecbc51027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd44719e63bb947bdb13e9309d1576521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:17.570579 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-f5906c42-b1f5-4b2f-aee4-f6e3c58fca31 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] 10.222.0.23 "GET /compute/v2.1/servers/fa6eab49-6809-41fa-96c5-a6297dbe51d6" status: 200 len: 1315 microversion: 2.1 time: 0.165667 Jul 12 13:28:17.571160 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 63/129] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:28:17 2022] GET /compute/v2.1/servers/fa6eab49-6809-41fa-96c5-a6297dbe51d6 => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:28:17.647697 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-79e02f67-ca20-4d14-87c3-618b33749bae tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:17.655571 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-79e02f67-ca20-4d14-87c3-618b33749bae tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:17.657209 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-79e02f67-ca20-4d14-87c3-618b33749bae tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:17.658551 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-79e02f67-ca20-4d14-87c3-618b33749bae tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f" status: 200 len: 1407 microversion: 2.20 time: 0.158405 Jul 12 13:28:17.659107 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 67/130] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:28:17 2022] GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 13:28:17.745193 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-1855b478-c4d1-43f0-a0b4-6acc6dd395b1 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:28:17.745768 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-1855b478-c4d1-43f0-a0b4-6acc6dd395b1 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] [instance: eeb0b554-cd09-49b5-95f0-22fc7c707944] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:28:17.752739 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-1855b478-c4d1-43f0-a0b4-6acc6dd395b1 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:17.753188 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-1855b478-c4d1-43f0-a0b4-6acc6dd395b1 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:17.754059 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-1855b478-c4d1-43f0-a0b4-6acc6dd395b1 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:17.754496 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-1855b478-c4d1-43f0-a0b4-6acc6dd395b1 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:17.759805 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-84701e3b-d6e0-430d-8a5a-c6ccb9a9a8fa tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:28:17.760434 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-84701e3b-d6e0-430d-8a5a-c6ccb9a9a8fa tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: 95edada5-d3ec-4056-99e9-379fb4b65394] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:28:17.762362 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG dbcounter [-] [117988] Writing DB stats nova_cell0:SELECT=2 {{(pid=117988) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:17.767693 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-84701e3b-d6e0-430d-8a5a-c6ccb9a9a8fa tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:17.768130 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-84701e3b-d6e0-430d-8a5a-c6ccb9a9a8fa tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:17.768885 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-84701e3b-d6e0-430d-8a5a-c6ccb9a9a8fa tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:17.769805 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-84701e3b-d6e0-430d-8a5a-c6ccb9a9a8fa tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:18.111067 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-1855b478-c4d1-43f0-a0b4-6acc6dd395b1 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b710bbdf0c4d58b4f3ee7ef7410c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8fca4ab6ed466a864c5551fea5f7ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:18.119406 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-1855b478-c4d1-43f0-a0b4-6acc6dd395b1 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] 10.222.0.23 "GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944" status: 200 len: 1363 microversion: 2.1 time: 0.378068 Jul 12 13:28:18.120253 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 64/131] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:28:17 2022] GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944 => generated 1363 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:28:18.134771 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-84701e3b-d6e0-430d-8a5a-c6ccb9a9a8fa tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f448776d1074e22bfe6cfbe05e01db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27fe465e6743e19feec424e6e9f3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:18.142894 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-84701e3b-d6e0-430d-8a5a-c6ccb9a9a8fa tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394" status: 200 len: 1321 microversion: 2.1 time: 0.386817 Jul 12 13:28:18.144048 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 68/132] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:28:17 2022] GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394 => generated 1321 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:28:18.588097 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-acf1c3e4-c9af-4598-b9d3-e1a52c6a0dd8 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:28:18.588717 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-acf1c3e4-c9af-4598-b9d3-e1a52c6a0dd8 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] [instance: fa6eab49-6809-41fa-96c5-a6297dbe51d6] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:28:18.595523 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-acf1c3e4-c9af-4598-b9d3-e1a52c6a0dd8 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:18.595935 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-acf1c3e4-c9af-4598-b9d3-e1a52c6a0dd8 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:18.596702 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-acf1c3e4-c9af-4598-b9d3-e1a52c6a0dd8 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:18.597424 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-acf1c3e4-c9af-4598-b9d3-e1a52c6a0dd8 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:18.681360 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-c92e5326-9f78-4d6c-9a68-c499129c183d tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:28:18.682468 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-c92e5326-9f78-4d6c-9a68-c499129c183d tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 5d30ed54-909d-491f-a14c-bc4435cfdc6f] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:28:18.691953 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-c92e5326-9f78-4d6c-9a68-c499129c183d tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:18.692535 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-c92e5326-9f78-4d6c-9a68-c499129c183d tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:18.693546 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-c92e5326-9f78-4d6c-9a68-c499129c183d tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:18.694209 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-c92e5326-9f78-4d6c-9a68-c499129c183d tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:18.751474 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-acf1c3e4-c9af-4598-b9d3-e1a52c6a0dd8 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbc8ad40b44661b526511ecbc51027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd44719e63bb947bdb13e9309d1576521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:18.759080 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-acf1c3e4-c9af-4598-b9d3-e1a52c6a0dd8 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] 10.222.0.23 "GET /compute/v2.1/servers/fa6eab49-6809-41fa-96c5-a6297dbe51d6" status: 200 len: 1315 microversion: 2.1 time: 0.174895 Jul 12 13:28:18.760011 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 65/133] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:28:18 2022] GET /compute/v2.1/servers/fa6eab49-6809-41fa-96c5-a6297dbe51d6 => generated 1315 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:28:18.842307 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-c92e5326-9f78-4d6c-9a68-c499129c183d tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:18.851103 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-c92e5326-9f78-4d6c-9a68-c499129c183d tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:18.852613 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-c92e5326-9f78-4d6c-9a68-c499129c183d tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:18.853743 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-c92e5326-9f78-4d6c-9a68-c499129c183d tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f" status: 200 len: 1407 microversion: 2.20 time: 0.180404 Jul 12 13:28:18.854301 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 69/134] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:28:18 2022] GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f => generated 1407 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:28:19.139209 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-d64f74cd-4ddb-4771-add2-818369549afd tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:28:19.139820 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-d64f74cd-4ddb-4771-add2-818369549afd tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] [instance: eeb0b554-cd09-49b5-95f0-22fc7c707944] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:28:19.147001 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-d64f74cd-4ddb-4771-add2-818369549afd tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:19.147496 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-d64f74cd-4ddb-4771-add2-818369549afd tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:19.148359 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-d64f74cd-4ddb-4771-add2-818369549afd tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:19.148870 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-d64f74cd-4ddb-4771-add2-818369549afd tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:19.159851 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-28afb6ec-5d09-4a1f-847e-315c95d6d3c9 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:28:19.160494 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-28afb6ec-5d09-4a1f-847e-315c95d6d3c9 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: 95edada5-d3ec-4056-99e9-379fb4b65394] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:28:19.166860 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-28afb6ec-5d09-4a1f-847e-315c95d6d3c9 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:19.167305 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-28afb6ec-5d09-4a1f-847e-315c95d6d3c9 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:19.168091 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-28afb6ec-5d09-4a1f-847e-315c95d6d3c9 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:19.168524 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-28afb6ec-5d09-4a1f-847e-315c95d6d3c9 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:19.356397 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-d64f74cd-4ddb-4771-add2-818369549afd tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b710bbdf0c4d58b4f3ee7ef7410c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8fca4ab6ed466a864c5551fea5f7ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:19.366142 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-d64f74cd-4ddb-4771-add2-818369549afd tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] 10.222.0.23 "GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944" status: 200 len: 1363 microversion: 2.1 time: 0.230922 Jul 12 13:28:19.366553 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-28afb6ec-5d09-4a1f-847e-315c95d6d3c9 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f448776d1074e22bfe6cfbe05e01db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27fe465e6743e19feec424e6e9f3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:19.369422 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 66/135] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:28:19 2022] GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944 => generated 1363 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:28:19.374785 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-28afb6ec-5d09-4a1f-847e-315c95d6d3c9 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394" status: 200 len: 1321 microversion: 2.1 time: 0.218942 Jul 12 13:28:19.380952 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 70/136] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:28:19 2022] GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394 => generated 1321 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:28:19.777953 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-6e9e1f97-f94c-4bba-844a-4edc583f73d5 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:28:19.778697 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-6e9e1f97-f94c-4bba-844a-4edc583f73d5 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] [instance: fa6eab49-6809-41fa-96c5-a6297dbe51d6] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:28:19.786579 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-6e9e1f97-f94c-4bba-844a-4edc583f73d5 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:19.787029 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-6e9e1f97-f94c-4bba-844a-4edc583f73d5 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:19.788000 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-6e9e1f97-f94c-4bba-844a-4edc583f73d5 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:19.788439 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-6e9e1f97-f94c-4bba-844a-4edc583f73d5 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:19.876206 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-197b0872-2516-4a46-8a2a-8485f65226b0 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:28:19.876968 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-197b0872-2516-4a46-8a2a-8485f65226b0 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 5d30ed54-909d-491f-a14c-bc4435cfdc6f] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:28:19.885553 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-197b0872-2516-4a46-8a2a-8485f65226b0 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:19.886173 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-197b0872-2516-4a46-8a2a-8485f65226b0 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:19.887049 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-197b0872-2516-4a46-8a2a-8485f65226b0 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:19.887575 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-197b0872-2516-4a46-8a2a-8485f65226b0 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:19.944870 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-6e9e1f97-f94c-4bba-844a-4edc583f73d5 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbc8ad40b44661b526511ecbc51027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd44719e63bb947bdb13e9309d1576521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:19.954707 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-6e9e1f97-f94c-4bba-844a-4edc583f73d5 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] 10.222.0.23 "GET /compute/v2.1/servers/fa6eab49-6809-41fa-96c5-a6297dbe51d6" status: 200 len: 1315 microversion: 2.1 time: 0.181108 Jul 12 13:28:19.964213 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 67/137] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:28:19 2022] GET /compute/v2.1/servers/fa6eab49-6809-41fa-96c5-a6297dbe51d6 => generated 1315 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:28:20.033680 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-197b0872-2516-4a46-8a2a-8485f65226b0 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:20.042282 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-197b0872-2516-4a46-8a2a-8485f65226b0 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:20.043798 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-197b0872-2516-4a46-8a2a-8485f65226b0 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:20.044960 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-197b0872-2516-4a46-8a2a-8485f65226b0 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f" status: 200 len: 1407 microversion: 2.20 time: 0.176581 Jul 12 13:28:20.045785 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 71/138] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:28:19 2022] GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f => generated 1407 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 13:28:20.384533 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-a5c009c3-e0ec-4700-83b2-74fb37889fb4 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:28:20.385185 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-a5c009c3-e0ec-4700-83b2-74fb37889fb4 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] [instance: eeb0b554-cd09-49b5-95f0-22fc7c707944] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:28:20.392806 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-a5c009c3-e0ec-4700-83b2-74fb37889fb4 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:20.393690 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-c4b45557-ddff-46ee-8e01-4bc08da52330 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:28:20.393951 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-a5c009c3-e0ec-4700-83b2-74fb37889fb4 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:20.394871 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-a5c009c3-e0ec-4700-83b2-74fb37889fb4 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:20.395216 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-c4b45557-ddff-46ee-8e01-4bc08da52330 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: 95edada5-d3ec-4056-99e9-379fb4b65394] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:28:20.395511 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-a5c009c3-e0ec-4700-83b2-74fb37889fb4 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:20.401549 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-c4b45557-ddff-46ee-8e01-4bc08da52330 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:20.402002 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-c4b45557-ddff-46ee-8e01-4bc08da52330 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:20.402843 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-c4b45557-ddff-46ee-8e01-4bc08da52330 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:20.403301 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-c4b45557-ddff-46ee-8e01-4bc08da52330 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:20.608600 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-a5c009c3-e0ec-4700-83b2-74fb37889fb4 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b710bbdf0c4d58b4f3ee7ef7410c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8fca4ab6ed466a864c5551fea5f7ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:20.615307 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-c4b45557-ddff-46ee-8e01-4bc08da52330 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f448776d1074e22bfe6cfbe05e01db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27fe465e6743e19feec424e6e9f3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:20.629352 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-c4b45557-ddff-46ee-8e01-4bc08da52330 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394" status: 200 len: 1321 microversion: 2.1 time: 0.240750 Jul 12 13:28:20.629649 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-a5c009c3-e0ec-4700-83b2-74fb37889fb4 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] 10.222.0.23 "GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944" status: 200 len: 1363 microversion: 2.1 time: 0.249178 Jul 12 13:28:20.639880 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 68/139] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:28:20 2022] GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944 => generated 1363 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:28:20.644658 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 72/140] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:28:20 2022] GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394 => generated 1321 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:28:20.973336 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-379de9f1-2522-4e74-ae47-03a9ae7727ce tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:28:20.973994 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-379de9f1-2522-4e74-ae47-03a9ae7727ce tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] [instance: fa6eab49-6809-41fa-96c5-a6297dbe51d6] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:28:20.980063 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-379de9f1-2522-4e74-ae47-03a9ae7727ce tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:20.980509 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-379de9f1-2522-4e74-ae47-03a9ae7727ce tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:20.981314 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-379de9f1-2522-4e74-ae47-03a9ae7727ce tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:20.981771 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-379de9f1-2522-4e74-ae47-03a9ae7727ce tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:21.064396 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-71395e71-af13-448e-8ef9-b4aeb7b02936 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:28:21.065430 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-71395e71-af13-448e-8ef9-b4aeb7b02936 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 5d30ed54-909d-491f-a14c-bc4435cfdc6f] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:28:21.071856 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-71395e71-af13-448e-8ef9-b4aeb7b02936 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:21.072304 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-71395e71-af13-448e-8ef9-b4aeb7b02936 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:21.073090 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-71395e71-af13-448e-8ef9-b4aeb7b02936 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:21.073539 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-71395e71-af13-448e-8ef9-b4aeb7b02936 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:21.166215 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-379de9f1-2522-4e74-ae47-03a9ae7727ce tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbc8ad40b44661b526511ecbc51027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd44719e63bb947bdb13e9309d1576521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:21.176151 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-379de9f1-2522-4e74-ae47-03a9ae7727ce tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] 10.222.0.23 "GET /compute/v2.1/servers/fa6eab49-6809-41fa-96c5-a6297dbe51d6" status: 200 len: 1315 microversion: 2.1 time: 0.208261 Jul 12 13:28:21.177159 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 69/141] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:28:20 2022] GET /compute/v2.1/servers/fa6eab49-6809-41fa-96c5-a6297dbe51d6 => generated 1315 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:28:21.252395 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-71395e71-af13-448e-8ef9-b4aeb7b02936 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:21.260516 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-71395e71-af13-448e-8ef9-b4aeb7b02936 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:21.262048 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-71395e71-af13-448e-8ef9-b4aeb7b02936 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:21.263343 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-71395e71-af13-448e-8ef9-b4aeb7b02936 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f" status: 200 len: 1407 microversion: 2.20 time: 0.203907 Jul 12 13:28:21.263901 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 73/142] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:28:21 2022] GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f => generated 1407 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 13:28:21.647132 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-3e285e0f-e9a2-4dc6-bd9a-c92e274406d6 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:28:21.647740 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-3e285e0f-e9a2-4dc6-bd9a-c92e274406d6 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] [instance: eeb0b554-cd09-49b5-95f0-22fc7c707944] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:28:21.653970 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-3e285e0f-e9a2-4dc6-bd9a-c92e274406d6 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:21.654471 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-3e285e0f-e9a2-4dc6-bd9a-c92e274406d6 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:21.654606 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-174330e6-a1e5-4007-a85b-aca3f32215b9 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:28:21.655740 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-174330e6-a1e5-4007-a85b-aca3f32215b9 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: 95edada5-d3ec-4056-99e9-379fb4b65394] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:28:21.655964 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-3e285e0f-e9a2-4dc6-bd9a-c92e274406d6 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:21.656303 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-3e285e0f-e9a2-4dc6-bd9a-c92e274406d6 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:21.665484 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-174330e6-a1e5-4007-a85b-aca3f32215b9 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:21.666189 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-174330e6-a1e5-4007-a85b-aca3f32215b9 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:21.667387 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-174330e6-a1e5-4007-a85b-aca3f32215b9 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:21.668058 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-174330e6-a1e5-4007-a85b-aca3f32215b9 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:21.883943 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-3e285e0f-e9a2-4dc6-bd9a-c92e274406d6 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b710bbdf0c4d58b4f3ee7ef7410c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8fca4ab6ed466a864c5551fea5f7ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:21.887856 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-174330e6-a1e5-4007-a85b-aca3f32215b9 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f448776d1074e22bfe6cfbe05e01db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27fe465e6743e19feec424e6e9f3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:21.893676 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-3e285e0f-e9a2-4dc6-bd9a-c92e274406d6 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] 10.222.0.23 "GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944" status: 200 len: 1363 microversion: 2.1 time: 0.250544 Jul 12 13:28:21.894265 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 70/143] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:28:21 2022] GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944 => generated 1363 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:28:21.905155 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-174330e6-a1e5-4007-a85b-aca3f32215b9 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394" status: 200 len: 1321 microversion: 2.1 time: 0.256904 Jul 12 13:28:21.905761 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 74/144] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:28:21 2022] GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394 => generated 1321 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:28:22.193961 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-2c38d9a9-4663-44c1-a701-3158feb00f71 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:28:22.194677 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-2c38d9a9-4663-44c1-a701-3158feb00f71 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] [instance: fa6eab49-6809-41fa-96c5-a6297dbe51d6] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:28:22.201298 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-2c38d9a9-4663-44c1-a701-3158feb00f71 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:22.202131 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-2c38d9a9-4663-44c1-a701-3158feb00f71 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:22.202987 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-2c38d9a9-4663-44c1-a701-3158feb00f71 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:22.203489 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-2c38d9a9-4663-44c1-a701-3158feb00f71 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:22.285325 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-b36bcb66-5077-40d9-9cb3-e30b11a29181 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:28:22.286134 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-b36bcb66-5077-40d9-9cb3-e30b11a29181 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 5d30ed54-909d-491f-a14c-bc4435cfdc6f] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:28:22.292674 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-b36bcb66-5077-40d9-9cb3-e30b11a29181 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:22.293160 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-b36bcb66-5077-40d9-9cb3-e30b11a29181 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:22.293931 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-b36bcb66-5077-40d9-9cb3-e30b11a29181 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:22.299001 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-b36bcb66-5077-40d9-9cb3-e30b11a29181 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:22.399952 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-2c38d9a9-4663-44c1-a701-3158feb00f71 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbc8ad40b44661b526511ecbc51027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd44719e63bb947bdb13e9309d1576521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:22.410216 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-2c38d9a9-4663-44c1-a701-3158feb00f71 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] 10.222.0.23 "GET /compute/v2.1/servers/fa6eab49-6809-41fa-96c5-a6297dbe51d6" status: 200 len: 1315 microversion: 2.1 time: 0.220918 Jul 12 13:28:22.410949 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 71/145] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:28:22 2022] GET /compute/v2.1/servers/fa6eab49-6809-41fa-96c5-a6297dbe51d6 => generated 1315 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:28:22.471647 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-b36bcb66-5077-40d9-9cb3-e30b11a29181 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:22.481286 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-b36bcb66-5077-40d9-9cb3-e30b11a29181 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:22.483077 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-b36bcb66-5077-40d9-9cb3-e30b11a29181 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:22.484184 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-b36bcb66-5077-40d9-9cb3-e30b11a29181 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f" status: 200 len: 1407 microversion: 2.20 time: 0.205570 Jul 12 13:28:22.484753 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 75/146] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:28:22 2022] GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f => generated 1407 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:28:22.912041 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-0855c1bc-2dbe-43de-a457-2fd253af8653 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:28:22.912779 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-0855c1bc-2dbe-43de-a457-2fd253af8653 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] [instance: eeb0b554-cd09-49b5-95f0-22fc7c707944] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:28:22.914999 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG dbcounter [-] [117987] Writing DB stats nova_api:SELECT=94 {{(pid=117987) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:22.920293 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-0855c1bc-2dbe-43de-a457-2fd253af8653 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:22.920762 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-0855c1bc-2dbe-43de-a457-2fd253af8653 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:22.921653 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-0855c1bc-2dbe-43de-a457-2fd253af8653 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:22.922163 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-0855c1bc-2dbe-43de-a457-2fd253af8653 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:22.926871 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-7058bd3c-ff78-4c58-b4a1-39ef526e1917 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:28:22.927741 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-7058bd3c-ff78-4c58-b4a1-39ef526e1917 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: 95edada5-d3ec-4056-99e9-379fb4b65394] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:28:22.936777 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-7058bd3c-ff78-4c58-b4a1-39ef526e1917 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:22.937925 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-7058bd3c-ff78-4c58-b4a1-39ef526e1917 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:22.938883 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-7058bd3c-ff78-4c58-b4a1-39ef526e1917 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:22.939503 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-7058bd3c-ff78-4c58-b4a1-39ef526e1917 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:22.962633 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG dbcounter [-] [117988] Writing DB stats nova_cell1:SELECT=100 {{(pid=117988) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:23.144039 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-0855c1bc-2dbe-43de-a457-2fd253af8653 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b710bbdf0c4d58b4f3ee7ef7410c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8fca4ab6ed466a864c5551fea5f7ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:23.147319 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-7058bd3c-ff78-4c58-b4a1-39ef526e1917 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f448776d1074e22bfe6cfbe05e01db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27fe465e6743e19feec424e6e9f3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:23.151395 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-0855c1bc-2dbe-43de-a457-2fd253af8653 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] 10.222.0.23 "GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944" status: 200 len: 1363 microversion: 2.1 time: 0.244497 Jul 12 13:28:23.151967 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 72/147] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:28:22 2022] GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944 => generated 1363 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:28:23.154821 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-7058bd3c-ff78-4c58-b4a1-39ef526e1917 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394" status: 200 len: 1321 microversion: 2.1 time: 0.235412 Jul 12 13:28:23.155460 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 76/148] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:28:22 2022] GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394 => generated 1321 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:28:23.427833 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-ed116189-6e7a-4b95-90d4-3e616eb7b0fe tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:28:23.428449 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-ed116189-6e7a-4b95-90d4-3e616eb7b0fe tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] [instance: fa6eab49-6809-41fa-96c5-a6297dbe51d6] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:28:23.434390 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-ed116189-6e7a-4b95-90d4-3e616eb7b0fe tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:23.434840 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-ed116189-6e7a-4b95-90d4-3e616eb7b0fe tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:23.435606 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-ed116189-6e7a-4b95-90d4-3e616eb7b0fe tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:23.436042 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-ed116189-6e7a-4b95-90d4-3e616eb7b0fe tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:23.503339 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-f60aa70d-a1e2-41c1-bb4c-f98142f59627 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:28:23.503975 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-f60aa70d-a1e2-41c1-bb4c-f98142f59627 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 5d30ed54-909d-491f-a14c-bc4435cfdc6f] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:28:23.510068 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-f60aa70d-a1e2-41c1-bb4c-f98142f59627 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:23.510523 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-f60aa70d-a1e2-41c1-bb4c-f98142f59627 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:23.511293 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-f60aa70d-a1e2-41c1-bb4c-f98142f59627 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:23.511730 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-f60aa70d-a1e2-41c1-bb4c-f98142f59627 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:23.600754 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-ed116189-6e7a-4b95-90d4-3e616eb7b0fe tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbc8ad40b44661b526511ecbc51027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd44719e63bb947bdb13e9309d1576521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:23.608418 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-ed116189-6e7a-4b95-90d4-3e616eb7b0fe tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] 10.222.0.23 "GET /compute/v2.1/servers/fa6eab49-6809-41fa-96c5-a6297dbe51d6" status: 200 len: 1315 microversion: 2.1 time: 0.184515 Jul 12 13:28:23.609060 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 73/149] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:28:23 2022] GET /compute/v2.1/servers/fa6eab49-6809-41fa-96c5-a6297dbe51d6 => generated 1315 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:28:23.666748 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-f60aa70d-a1e2-41c1-bb4c-f98142f59627 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:23.675233 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-f60aa70d-a1e2-41c1-bb4c-f98142f59627 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:23.676737 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-f60aa70d-a1e2-41c1-bb4c-f98142f59627 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:23.677872 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-f60aa70d-a1e2-41c1-bb4c-f98142f59627 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f" status: 200 len: 1407 microversion: 2.20 time: 0.179175 Jul 12 13:28:23.678427 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 77/150] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:28:23 2022] GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f => generated 1407 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 13:28:24.168999 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-4cc90946-29ce-4cbb-95e0-97ffd997bdb5 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:28:24.169554 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-4cc90946-29ce-4cbb-95e0-97ffd997bdb5 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] [instance: eeb0b554-cd09-49b5-95f0-22fc7c707944] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:28:24.171634 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-0fe27791-c9ab-422a-a8e4-48d741452668 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:28:24.172239 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-0fe27791-c9ab-422a-a8e4-48d741452668 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: 95edada5-d3ec-4056-99e9-379fb4b65394] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:28:24.175738 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-4cc90946-29ce-4cbb-95e0-97ffd997bdb5 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:24.176185 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-4cc90946-29ce-4cbb-95e0-97ffd997bdb5 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:24.176945 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-4cc90946-29ce-4cbb-95e0-97ffd997bdb5 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:24.177404 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-4cc90946-29ce-4cbb-95e0-97ffd997bdb5 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:24.178136 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-0fe27791-c9ab-422a-a8e4-48d741452668 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:24.178582 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-0fe27791-c9ab-422a-a8e4-48d741452668 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:24.179325 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-0fe27791-c9ab-422a-a8e4-48d741452668 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:24.179753 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-0fe27791-c9ab-422a-a8e4-48d741452668 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:24.385772 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-4cc90946-29ce-4cbb-95e0-97ffd997bdb5 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b710bbdf0c4d58b4f3ee7ef7410c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8fca4ab6ed466a864c5551fea5f7ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:24.388105 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-0fe27791-c9ab-422a-a8e4-48d741452668 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f448776d1074e22bfe6cfbe05e01db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27fe465e6743e19feec424e6e9f3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:24.395822 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-4cc90946-29ce-4cbb-95e0-97ffd997bdb5 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] 10.222.0.23 "GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944" status: 200 len: 1363 microversion: 2.1 time: 0.230677 Jul 12 13:28:24.396744 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-0fe27791-c9ab-422a-a8e4-48d741452668 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394" status: 200 len: 1321 microversion: 2.1 time: 0.228789 Jul 12 13:28:24.402713 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 74/151] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:28:24 2022] GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944 => generated 1363 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:28:24.404608 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 78/152] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:28:24 2022] GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394 => generated 1321 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:28:24.626234 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-017dc2a8-0949-415d-ab33-367faf1a1127 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:28:24.626893 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-017dc2a8-0949-415d-ab33-367faf1a1127 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] [instance: fa6eab49-6809-41fa-96c5-a6297dbe51d6] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:28:24.633611 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-017dc2a8-0949-415d-ab33-367faf1a1127 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:24.634063 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-017dc2a8-0949-415d-ab33-367faf1a1127 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:24.634856 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-017dc2a8-0949-415d-ab33-367faf1a1127 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:24.635291 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-017dc2a8-0949-415d-ab33-367faf1a1127 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:24.698443 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-79969169-2223-45b9-844d-986845ddb40c tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:28:24.699202 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-79969169-2223-45b9-844d-986845ddb40c tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 5d30ed54-909d-491f-a14c-bc4435cfdc6f] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:28:24.701471 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG dbcounter [-] [117988] Writing DB stats nova_api:SELECT=99 {{(pid=117988) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:24.712694 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-79969169-2223-45b9-844d-986845ddb40c tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:24.712694 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-79969169-2223-45b9-844d-986845ddb40c tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:24.712694 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-79969169-2223-45b9-844d-986845ddb40c tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:24.712694 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-79969169-2223-45b9-844d-986845ddb40c tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:24.833662 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-017dc2a8-0949-415d-ab33-367faf1a1127 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbc8ad40b44661b526511ecbc51027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd44719e63bb947bdb13e9309d1576521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:24.845050 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-017dc2a8-0949-415d-ab33-367faf1a1127 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] 10.222.0.23 "GET /compute/v2.1/servers/fa6eab49-6809-41fa-96c5-a6297dbe51d6" status: 200 len: 1315 microversion: 2.1 time: 0.222955 Jul 12 13:28:24.846127 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 75/153] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:28:24 2022] GET /compute/v2.1/servers/fa6eab49-6809-41fa-96c5-a6297dbe51d6 => generated 1315 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:28:24.896061 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-79969169-2223-45b9-844d-986845ddb40c tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:24.904220 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-79969169-2223-45b9-844d-986845ddb40c tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:24.905800 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-79969169-2223-45b9-844d-986845ddb40c tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:24.906930 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-79969169-2223-45b9-844d-986845ddb40c tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f" status: 200 len: 1407 microversion: 2.20 time: 0.213971 Jul 12 13:28:24.907505 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 79/154] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:28:24 2022] GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f => generated 1407 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 13:28:25.415970 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-8b58e440-9310-424e-a637-1618b4eef001 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:28:25.417597 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-8b58e440-9310-424e-a637-1618b4eef001 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] [instance: eeb0b554-cd09-49b5-95f0-22fc7c707944] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:28:25.427816 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-8b58e440-9310-424e-a637-1618b4eef001 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:25.431032 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-8b58e440-9310-424e-a637-1618b4eef001 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:25.432092 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-8b58e440-9310-424e-a637-1618b4eef001 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:25.432737 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-8b58e440-9310-424e-a637-1618b4eef001 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:25.435745 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-06d9baf9-6606-4d14-af51-09149796fe4a tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:28:25.436380 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-06d9baf9-6606-4d14-af51-09149796fe4a tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: 95edada5-d3ec-4056-99e9-379fb4b65394] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:28:25.460233 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-06d9baf9-6606-4d14-af51-09149796fe4a tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:25.464253 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-06d9baf9-6606-4d14-af51-09149796fe4a tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:25.466153 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-06d9baf9-6606-4d14-af51-09149796fe4a tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:25.466614 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-06d9baf9-6606-4d14-af51-09149796fe4a tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:26.108118 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-06d9baf9-6606-4d14-af51-09149796fe4a tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f448776d1074e22bfe6cfbe05e01db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27fe465e6743e19feec424e6e9f3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:26.134714 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-06d9baf9-6606-4d14-af51-09149796fe4a tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394" status: 200 len: 1321 microversion: 2.1 time: 0.715837 Jul 12 13:28:26.136006 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 80/155] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:28:25 2022] GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394 => generated 1321 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:28:26.142646 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-8b58e440-9310-424e-a637-1618b4eef001 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b710bbdf0c4d58b4f3ee7ef7410c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8fca4ab6ed466a864c5551fea5f7ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:26.154419 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-b3cd4813-d1bb-449e-b547-9e6c8511da95 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:28:26.157338 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-8b58e440-9310-424e-a637-1618b4eef001 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] 10.222.0.23 "GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944" status: 200 len: 1363 microversion: 2.1 time: 0.745393 Jul 12 13:28:26.158365 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-b3cd4813-d1bb-449e-b547-9e6c8511da95 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] [instance: fa6eab49-6809-41fa-96c5-a6297dbe51d6] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:28:26.162062 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 76/156] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:28:25 2022] GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944 => generated 1363 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:28:26.168283 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-b2c6e176-0702-4596-9dfd-914d873102e3 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:28:26.172181 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-b3cd4813-d1bb-449e-b547-9e6c8511da95 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:26.172635 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-b3cd4813-d1bb-449e-b547-9e6c8511da95 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:26.173441 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-b3cd4813-d1bb-449e-b547-9e6c8511da95 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:26.173882 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-b3cd4813-d1bb-449e-b547-9e6c8511da95 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:26.177555 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-b2c6e176-0702-4596-9dfd-914d873102e3 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 5d30ed54-909d-491f-a14c-bc4435cfdc6f] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:28:26.186130 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-b2c6e176-0702-4596-9dfd-914d873102e3 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:26.186588 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-b2c6e176-0702-4596-9dfd-914d873102e3 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:26.187617 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-b2c6e176-0702-4596-9dfd-914d873102e3 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:26.188609 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-b2c6e176-0702-4596-9dfd-914d873102e3 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:26.494359 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-b3cd4813-d1bb-449e-b547-9e6c8511da95 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbc8ad40b44661b526511ecbc51027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd44719e63bb947bdb13e9309d1576521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:26.499013 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-b2c6e176-0702-4596-9dfd-914d873102e3 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:26.506954 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-b3cd4813-d1bb-449e-b547-9e6c8511da95 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] 10.222.0.23 "GET /compute/v2.1/servers/fa6eab49-6809-41fa-96c5-a6297dbe51d6" status: 200 len: 1315 microversion: 2.1 time: 0.368721 Jul 12 13:28:26.510166 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 81/157] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:28:26 2022] GET /compute/v2.1/servers/fa6eab49-6809-41fa-96c5-a6297dbe51d6 => generated 1315 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:28:26.520872 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-b2c6e176-0702-4596-9dfd-914d873102e3 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:26.523930 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-b2c6e176-0702-4596-9dfd-914d873102e3 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:26.525538 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-b2c6e176-0702-4596-9dfd-914d873102e3 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f" status: 200 len: 1407 microversion: 2.20 time: 0.362090 Jul 12 13:28:26.526502 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 77/158] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:28:26 2022] GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f => generated 1407 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:28:26.701027 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [req-7c2025ba-f197-4b7d-a49a-bd70c2fd607a req-2374c565-98e4-4d67-bf3c-b500912001e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d30ed54-909d-491f-a14c-bc4435cfdc6f", "name": "network-vif-plugged", "status": "completed", "tag": "f13aa237-fefb-4e93-8923-7007031116c1"}]} {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:28:26.713004 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [req-7c2025ba-f197-4b7d-a49a-bd70c2fd607a req-2374c565-98e4-4d67-bf3c-b500912001e3 service nova] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:26.713674 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [req-7c2025ba-f197-4b7d-a49a-bd70c2fd607a req-2374c565-98e4-4d67-bf3c-b500912001e3 service nova] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:26.731302 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.compute.server_external_events [req-7c2025ba-f197-4b7d-a49a-bd70c2fd607a req-2374c565-98e4-4d67-bf3c-b500912001e3 service nova] Creating event network-vif-plugged:f13aa237-fefb-4e93-8923-7007031116c1 for instance 5d30ed54-909d-491f-a14c-bc4435cfdc6f on hv-cinder-82002 Jul 12 13:28:26.740408 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [req-7c2025ba-f197-4b7d-a49a-bd70c2fd607a req-2374c565-98e4-4d67-bf3c-b500912001e3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.228362 Jul 12 13:28:26.741033 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 82/159] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 12 13:28:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:28:27.154113 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-7f1cded6-5e32-4987-8210-5d198e60045e tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:28:27.154532 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-7f1cded6-5e32-4987-8210-5d198e60045e tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: 95edada5-d3ec-4056-99e9-379fb4b65394] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:28:27.161197 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-7f1cded6-5e32-4987-8210-5d198e60045e tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:27.161661 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-7f1cded6-5e32-4987-8210-5d198e60045e tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:27.162650 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-7f1cded6-5e32-4987-8210-5d198e60045e tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:27.163135 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-7f1cded6-5e32-4987-8210-5d198e60045e tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:27.177783 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-bbc4a994-0c0d-4e99-ac6e-eaf7b873f844 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:28:27.178485 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-bbc4a994-0c0d-4e99-ac6e-eaf7b873f844 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] [instance: eeb0b554-cd09-49b5-95f0-22fc7c707944] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:28:27.185561 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-bbc4a994-0c0d-4e99-ac6e-eaf7b873f844 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:27.186148 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-bbc4a994-0c0d-4e99-ac6e-eaf7b873f844 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:27.187926 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-bbc4a994-0c0d-4e99-ac6e-eaf7b873f844 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:27.188417 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-bbc4a994-0c0d-4e99-ac6e-eaf7b873f844 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:27.388161 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-7f1cded6-5e32-4987-8210-5d198e60045e tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f448776d1074e22bfe6cfbe05e01db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27fe465e6743e19feec424e6e9f3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:27.395950 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-bbc4a994-0c0d-4e99-ac6e-eaf7b873f844 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b710bbdf0c4d58b4f3ee7ef7410c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8fca4ab6ed466a864c5551fea5f7ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:27.396977 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-7f1cded6-5e32-4987-8210-5d198e60045e tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394" status: 200 len: 1321 microversion: 2.1 time: 0.247349 Jul 12 13:28:27.397610 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 78/160] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:28:27 2022] GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394 => generated 1321 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:28:27.405126 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-bbc4a994-0c0d-4e99-ac6e-eaf7b873f844 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] 10.222.0.23 "GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944" status: 200 len: 1363 microversion: 2.1 time: 0.232710 Jul 12 13:28:27.406033 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 83/161] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:28:27 2022] GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944 => generated 1363 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:28:27.527377 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-8e2444ec-96d1-4b85-9783-b752c73c166a tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:28:27.528115 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-8e2444ec-96d1-4b85-9783-b752c73c166a tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] [instance: fa6eab49-6809-41fa-96c5-a6297dbe51d6] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:28:27.536819 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-8e2444ec-96d1-4b85-9783-b752c73c166a tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:27.538654 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-8e2444ec-96d1-4b85-9783-b752c73c166a tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:27.539583 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-8e2444ec-96d1-4b85-9783-b752c73c166a tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:27.540382 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-8e2444ec-96d1-4b85-9783-b752c73c166a tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:27.552602 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-2f38d5b1-8a87-4313-bc4e-8c3d4d8ed67f tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:28:27.553605 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-2f38d5b1-8a87-4313-bc4e-8c3d4d8ed67f tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 5d30ed54-909d-491f-a14c-bc4435cfdc6f] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:28:27.579320 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-2f38d5b1-8a87-4313-bc4e-8c3d4d8ed67f tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:27.580564 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-2f38d5b1-8a87-4313-bc4e-8c3d4d8ed67f tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:27.580686 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG dbcounter [-] [117987] Writing DB stats nova_cell1:SELECT=100 {{(pid=117987) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:27.583489 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-2f38d5b1-8a87-4313-bc4e-8c3d4d8ed67f tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:27.584048 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-2f38d5b1-8a87-4313-bc4e-8c3d4d8ed67f tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:27.772708 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-8e2444ec-96d1-4b85-9783-b752c73c166a tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbc8ad40b44661b526511ecbc51027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd44719e63bb947bdb13e9309d1576521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:27.799165 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-8e2444ec-96d1-4b85-9783-b752c73c166a tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] 10.222.0.23 "GET /compute/v2.1/servers/fa6eab49-6809-41fa-96c5-a6297dbe51d6" status: 200 len: 1315 microversion: 2.1 time: 0.274029 Jul 12 13:28:27.800615 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 79/162] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:28:27 2022] GET /compute/v2.1/servers/fa6eab49-6809-41fa-96c5-a6297dbe51d6 => generated 1315 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:28:27.808089 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-2f38d5b1-8a87-4313-bc4e-8c3d4d8ed67f tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:27.833958 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-2f38d5b1-8a87-4313-bc4e-8c3d4d8ed67f tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:27.839840 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-2f38d5b1-8a87-4313-bc4e-8c3d4d8ed67f tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:27.841095 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-2f38d5b1-8a87-4313-bc4e-8c3d4d8ed67f tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f" status: 200 len: 1407 microversion: 2.20 time: 0.297655 Jul 12 13:28:27.841927 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 84/163] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:28:27 2022] GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f => generated 1407 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:28:28.426938 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-020ac827-f2c1-4902-9bac-e03179491df0 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:28:28.427628 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-020ac827-f2c1-4902-9bac-e03179491df0 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] [instance: eeb0b554-cd09-49b5-95f0-22fc7c707944] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:28:28.429726 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-306d9950-811d-42b9-a9a1-17ba4e840b0d tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:28:28.431971 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-306d9950-811d-42b9-a9a1-17ba4e840b0d tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: 95edada5-d3ec-4056-99e9-379fb4b65394] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:28:28.435231 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-020ac827-f2c1-4902-9bac-e03179491df0 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:28.435811 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-020ac827-f2c1-4902-9bac-e03179491df0 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:28.436939 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-020ac827-f2c1-4902-9bac-e03179491df0 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:28.437768 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-020ac827-f2c1-4902-9bac-e03179491df0 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:28.442998 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-306d9950-811d-42b9-a9a1-17ba4e840b0d tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:28.443638 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-306d9950-811d-42b9-a9a1-17ba4e840b0d tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:28.444821 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-306d9950-811d-42b9-a9a1-17ba4e840b0d tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:28.445758 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-306d9950-811d-42b9-a9a1-17ba4e840b0d tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:28.760548 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-020ac827-f2c1-4902-9bac-e03179491df0 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b710bbdf0c4d58b4f3ee7ef7410c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8fca4ab6ed466a864c5551fea5f7ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:28.768435 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-306d9950-811d-42b9-a9a1-17ba4e840b0d tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f448776d1074e22bfe6cfbe05e01db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27fe465e6743e19feec424e6e9f3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:28.777035 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-020ac827-f2c1-4902-9bac-e03179491df0 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] 10.222.0.23 "GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944" status: 200 len: 1363 microversion: 2.1 time: 0.357023 Jul 12 13:28:28.777844 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-306d9950-811d-42b9-a9a1-17ba4e840b0d tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394" status: 200 len: 1321 microversion: 2.1 time: 0.367347 Jul 12 13:28:28.778059 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 85/164] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:28:28 2022] GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944 => generated 1363 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:28:28.785834 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 80/165] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:28:28 2022] GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394 => generated 1321 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:28:28.818727 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-0ebf327d-cd1d-480a-ba09-8acb3f3fb654 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:28:28.819715 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-0ebf327d-cd1d-480a-ba09-8acb3f3fb654 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] [instance: fa6eab49-6809-41fa-96c5-a6297dbe51d6] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:28:28.827327 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-0ebf327d-cd1d-480a-ba09-8acb3f3fb654 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:28.828218 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-0ebf327d-cd1d-480a-ba09-8acb3f3fb654 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:28.829568 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-0ebf327d-cd1d-480a-ba09-8acb3f3fb654 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:28.830256 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-0ebf327d-cd1d-480a-ba09-8acb3f3fb654 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:28.860057 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-0452332f-249e-4766-ac97-863ce53382f9 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:28:28.860667 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-0452332f-249e-4766-ac97-863ce53382f9 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 5d30ed54-909d-491f-a14c-bc4435cfdc6f] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:28:28.872015 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-0452332f-249e-4766-ac97-863ce53382f9 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:28.872654 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-0452332f-249e-4766-ac97-863ce53382f9 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:28.873469 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-0452332f-249e-4766-ac97-863ce53382f9 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:28.873906 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-0452332f-249e-4766-ac97-863ce53382f9 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:29.230776 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-0452332f-249e-4766-ac97-863ce53382f9 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:29.242962 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-0ebf327d-cd1d-480a-ba09-8acb3f3fb654 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbc8ad40b44661b526511ecbc51027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd44719e63bb947bdb13e9309d1576521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:29.254506 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-0452332f-249e-4766-ac97-863ce53382f9 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:29.260983 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-0452332f-249e-4766-ac97-863ce53382f9 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:29.263027 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-0452332f-249e-4766-ac97-863ce53382f9 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f" status: 200 len: 1407 microversion: 2.20 time: 0.406934 Jul 12 13:28:29.263824 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-0ebf327d-cd1d-480a-ba09-8acb3f3fb654 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] 10.222.0.23 "GET /compute/v2.1/servers/fa6eab49-6809-41fa-96c5-a6297dbe51d6" status: 200 len: 1315 microversion: 2.1 time: 0.449705 Jul 12 13:28:29.264917 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 86/166] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:28:28 2022] GET /compute/v2.1/servers/fa6eab49-6809-41fa-96c5-a6297dbe51d6 => generated 1315 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:28:29.266539 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 81/167] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:28:28 2022] GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f => generated 1407 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 13:28:29.740168 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [req-d48f1cc9-856f-44e3-addb-e888e649bee5 req-bbf4a691-735f-4cef-afc9-088b8323d562 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eeb0b554-cd09-49b5-95f0-22fc7c707944", "name": "network-vif-plugged", "status": "completed", "tag": "1611c489-7c46-47eb-9b57-cd5d00147d26"}]} {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:28:29.758687 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [req-d48f1cc9-856f-44e3-addb-e888e649bee5 req-bbf4a691-735f-4cef-afc9-088b8323d562 service nova] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:29.759150 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [req-d48f1cc9-856f-44e3-addb-e888e649bee5 req-bbf4a691-735f-4cef-afc9-088b8323d562 service nova] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:29.781677 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.compute.server_external_events [req-d48f1cc9-856f-44e3-addb-e888e649bee5 req-bbf4a691-735f-4cef-afc9-088b8323d562 service nova] Creating event network-vif-plugged:1611c489-7c46-47eb-9b57-cd5d00147d26 for instance eeb0b554-cd09-49b5-95f0-22fc7c707944 on hv-cinder-82002 Jul 12 13:28:29.802470 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-569887c8-c072-43b7-815a-76c405501afc tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:28:29.804457 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-569887c8-c072-43b7-815a-76c405501afc tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] [instance: eeb0b554-cd09-49b5-95f0-22fc7c707944] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:28:29.806877 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [req-d48f1cc9-856f-44e3-addb-e888e649bee5 req-bbf4a691-735f-4cef-afc9-088b8323d562 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074437 Jul 12 13:28:29.807745 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 87/168] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 12 13:28:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:28:29.813657 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-569887c8-c072-43b7-815a-76c405501afc tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:29.816148 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-569887c8-c072-43b7-815a-76c405501afc tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:29.817391 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-569887c8-c072-43b7-815a-76c405501afc tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:29.818258 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-569887c8-c072-43b7-815a-76c405501afc tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:29.818458 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-0d0fdbab-3e3b-4b84-9c71-67b50a8cfe57 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:28:29.820126 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-0d0fdbab-3e3b-4b84-9c71-67b50a8cfe57 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: 95edada5-d3ec-4056-99e9-379fb4b65394] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:28:29.832109 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-0d0fdbab-3e3b-4b84-9c71-67b50a8cfe57 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:29.833219 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-0d0fdbab-3e3b-4b84-9c71-67b50a8cfe57 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:29.834992 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-0d0fdbab-3e3b-4b84-9c71-67b50a8cfe57 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:29.845629 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-0d0fdbab-3e3b-4b84-9c71-67b50a8cfe57 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:30.277000 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-569887c8-c072-43b7-815a-76c405501afc tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b710bbdf0c4d58b4f3ee7ef7410c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8fca4ab6ed466a864c5551fea5f7ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:30.286634 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-0d0fdbab-3e3b-4b84-9c71-67b50a8cfe57 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f448776d1074e22bfe6cfbe05e01db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27fe465e6743e19feec424e6e9f3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:30.290705 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-569887c8-c072-43b7-815a-76c405501afc tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] 10.222.0.23 "GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944" status: 200 len: 1363 microversion: 2.1 time: 0.499345 Jul 12 13:28:30.295679 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-0d0fdbab-3e3b-4b84-9c71-67b50a8cfe57 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394" status: 200 len: 1321 microversion: 2.1 time: 0.486314 Jul 12 13:28:30.296230 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 88/169] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:28:29 2022] GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394 => generated 1321 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:28:30.301793 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-30ce4151-1ed8-479e-ad68-fbeadfdf61dc tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:28:30.302186 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 82/170] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:28:29 2022] GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944 => generated 1363 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:28:30.302838 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-30ce4151-1ed8-479e-ad68-fbeadfdf61dc tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] [instance: fa6eab49-6809-41fa-96c5-a6297dbe51d6] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:28:30.307778 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-bb521553-221e-4e13-b4e5-632aef636ded tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:28:30.308465 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-bb521553-221e-4e13-b4e5-632aef636ded tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 5d30ed54-909d-491f-a14c-bc4435cfdc6f] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:28:30.309419 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-30ce4151-1ed8-479e-ad68-fbeadfdf61dc tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:30.310057 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-30ce4151-1ed8-479e-ad68-fbeadfdf61dc tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:30.311014 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-30ce4151-1ed8-479e-ad68-fbeadfdf61dc tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:30.311622 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-30ce4151-1ed8-479e-ad68-fbeadfdf61dc tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:30.324055 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-bb521553-221e-4e13-b4e5-632aef636ded tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:30.325046 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-bb521553-221e-4e13-b4e5-632aef636ded tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:30.326123 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-bb521553-221e-4e13-b4e5-632aef636ded tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:30.329080 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-bb521553-221e-4e13-b4e5-632aef636ded tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:30.565865 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-30ce4151-1ed8-479e-ad68-fbeadfdf61dc tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbc8ad40b44661b526511ecbc51027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd44719e63bb947bdb13e9309d1576521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:30.574936 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-30ce4151-1ed8-479e-ad68-fbeadfdf61dc tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] 10.222.0.23 "GET /compute/v2.1/servers/fa6eab49-6809-41fa-96c5-a6297dbe51d6" status: 200 len: 1315 microversion: 2.1 time: 0.277622 Jul 12 13:28:30.575490 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 89/171] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:28:30 2022] GET /compute/v2.1/servers/fa6eab49-6809-41fa-96c5-a6297dbe51d6 => generated 1315 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:28:30.592544 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-bb521553-221e-4e13-b4e5-632aef636ded tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:30.607092 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-bb521553-221e-4e13-b4e5-632aef636ded tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:30.610157 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-bb521553-221e-4e13-b4e5-632aef636ded tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:30.612610 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-bb521553-221e-4e13-b4e5-632aef636ded tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f" status: 200 len: 1407 microversion: 2.20 time: 0.308296 Jul 12 13:28:30.625305 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 83/172] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:28:30 2022] GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f => generated 1407 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:28:31.315268 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-827f7d6d-7856-4b5a-adba-144c69fcd3f6 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:28:31.317129 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-1b9f2428-a0d2-4197-baee-e364a8556790 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:28:31.318313 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-1b9f2428-a0d2-4197-baee-e364a8556790 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: 95edada5-d3ec-4056-99e9-379fb4b65394] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:28:31.319490 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-827f7d6d-7856-4b5a-adba-144c69fcd3f6 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] [instance: eeb0b554-cd09-49b5-95f0-22fc7c707944] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:28:31.329461 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-1b9f2428-a0d2-4197-baee-e364a8556790 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:31.330365 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-1b9f2428-a0d2-4197-baee-e364a8556790 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:31.331450 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-1b9f2428-a0d2-4197-baee-e364a8556790 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:31.331884 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-1b9f2428-a0d2-4197-baee-e364a8556790 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:31.332270 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-827f7d6d-7856-4b5a-adba-144c69fcd3f6 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:31.333074 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-827f7d6d-7856-4b5a-adba-144c69fcd3f6 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:31.333928 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-827f7d6d-7856-4b5a-adba-144c69fcd3f6 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:31.334371 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-827f7d6d-7856-4b5a-adba-144c69fcd3f6 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:31.819960 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-1b9f2428-a0d2-4197-baee-e364a8556790 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f448776d1074e22bfe6cfbe05e01db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27fe465e6743e19feec424e6e9f3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:31.834364 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-1b9f2428-a0d2-4197-baee-e364a8556790 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394" status: 200 len: 1321 microversion: 2.1 time: 0.524203 Jul 12 13:28:31.840833 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 84/173] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:28:31 2022] GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394 => generated 1321 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:28:31.847795 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-186163c0-c675-4c78-bd92-2d40a6fef8c0 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:28:31.851030 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-186163c0-c675-4c78-bd92-2d40a6fef8c0 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] [instance: fa6eab49-6809-41fa-96c5-a6297dbe51d6] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:28:31.864671 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-186163c0-c675-4c78-bd92-2d40a6fef8c0 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:31.866851 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-186163c0-c675-4c78-bd92-2d40a6fef8c0 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:31.868352 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-186163c0-c675-4c78-bd92-2d40a6fef8c0 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:31.870163 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-186163c0-c675-4c78-bd92-2d40a6fef8c0 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:31.971563 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-827f7d6d-7856-4b5a-adba-144c69fcd3f6 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b710bbdf0c4d58b4f3ee7ef7410c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8fca4ab6ed466a864c5551fea5f7ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:31.981530 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-827f7d6d-7856-4b5a-adba-144c69fcd3f6 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] 10.222.0.23 "GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944" status: 200 len: 1363 microversion: 2.1 time: 0.676996 Jul 12 13:28:31.992979 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 90/174] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:28:31 2022] GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944 => generated 1363 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:28:31.998187 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-4c08dca4-5166-4e8f-9c5b-7c07eef0886f tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:28:32.009785 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-4c08dca4-5166-4e8f-9c5b-7c07eef0886f tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 5d30ed54-909d-491f-a14c-bc4435cfdc6f] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:28:32.031836 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-4c08dca4-5166-4e8f-9c5b-7c07eef0886f tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:32.036303 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-4c08dca4-5166-4e8f-9c5b-7c07eef0886f tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:32.040091 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-4c08dca4-5166-4e8f-9c5b-7c07eef0886f tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:32.041552 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-4c08dca4-5166-4e8f-9c5b-7c07eef0886f tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:32.364544 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-186163c0-c675-4c78-bd92-2d40a6fef8c0 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbc8ad40b44661b526511ecbc51027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd44719e63bb947bdb13e9309d1576521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:32.380091 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-186163c0-c675-4c78-bd92-2d40a6fef8c0 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] 10.222.0.23 "GET /compute/v2.1/servers/fa6eab49-6809-41fa-96c5-a6297dbe51d6" status: 200 len: 1315 microversion: 2.1 time: 0.537810 Jul 12 13:28:32.381446 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 85/175] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:28:31 2022] GET /compute/v2.1/servers/fa6eab49-6809-41fa-96c5-a6297dbe51d6 => generated 1315 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:28:32.489337 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-4c08dca4-5166-4e8f-9c5b-7c07eef0886f tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:32.499208 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-4c08dca4-5166-4e8f-9c5b-7c07eef0886f tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:32.508952 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-4c08dca4-5166-4e8f-9c5b-7c07eef0886f tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:32.510386 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-4c08dca4-5166-4e8f-9c5b-7c07eef0886f tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f" status: 200 len: 1407 microversion: 2.20 time: 0.516129 Jul 12 13:28:32.514650 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 91/176] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:28:31 2022] GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f => generated 1407 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:28:32.854069 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-597a3172-0d71-4cc4-8594-8bf2f4e5a31e tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:28:32.854749 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-597a3172-0d71-4cc4-8594-8bf2f4e5a31e tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: 95edada5-d3ec-4056-99e9-379fb4b65394] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:28:32.862248 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-597a3172-0d71-4cc4-8594-8bf2f4e5a31e tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:32.863052 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-597a3172-0d71-4cc4-8594-8bf2f4e5a31e tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:32.864500 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-597a3172-0d71-4cc4-8594-8bf2f4e5a31e tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:32.864938 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-597a3172-0d71-4cc4-8594-8bf2f4e5a31e tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:33.010590 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-fc1b9dab-3008-4d38-8205-dd00954f02c7 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:28:33.011212 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-fc1b9dab-3008-4d38-8205-dd00954f02c7 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] [instance: eeb0b554-cd09-49b5-95f0-22fc7c707944] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:28:33.024564 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-fc1b9dab-3008-4d38-8205-dd00954f02c7 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:33.025034 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-fc1b9dab-3008-4d38-8205-dd00954f02c7 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:33.027199 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-fc1b9dab-3008-4d38-8205-dd00954f02c7 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:33.028110 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-fc1b9dab-3008-4d38-8205-dd00954f02c7 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:33.057162 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-597a3172-0d71-4cc4-8594-8bf2f4e5a31e tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f448776d1074e22bfe6cfbe05e01db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27fe465e6743e19feec424e6e9f3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:33.069876 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-597a3172-0d71-4cc4-8594-8bf2f4e5a31e tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394" status: 200 len: 1321 microversion: 2.1 time: 0.220146 Jul 12 13:28:33.070462 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 86/177] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:28:32 2022] GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394 => generated 1321 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:28:33.221671 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-fc1b9dab-3008-4d38-8205-dd00954f02c7 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b710bbdf0c4d58b4f3ee7ef7410c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8fca4ab6ed466a864c5551fea5f7ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:33.234908 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-fc1b9dab-3008-4d38-8205-dd00954f02c7 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] 10.222.0.23 "GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944" status: 200 len: 1363 microversion: 2.1 time: 0.229008 Jul 12 13:28:33.235834 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 92/178] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:28:33 2022] GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944 => generated 1363 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:28:33.400515 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-399cd4a2-5d4c-4d54-b0f9-4103ede498a6 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:28:33.401460 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-399cd4a2-5d4c-4d54-b0f9-4103ede498a6 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] [instance: fa6eab49-6809-41fa-96c5-a6297dbe51d6] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:28:33.409748 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-399cd4a2-5d4c-4d54-b0f9-4103ede498a6 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:33.410741 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-399cd4a2-5d4c-4d54-b0f9-4103ede498a6 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:33.411693 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-399cd4a2-5d4c-4d54-b0f9-4103ede498a6 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:33.412430 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-399cd4a2-5d4c-4d54-b0f9-4103ede498a6 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:33.530749 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-0abd7206-341c-45c3-a639-24f724091a60 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:28:33.531474 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-0abd7206-341c-45c3-a639-24f724091a60 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 5d30ed54-909d-491f-a14c-bc4435cfdc6f] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:28:33.540554 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-0abd7206-341c-45c3-a639-24f724091a60 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:33.541000 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-0abd7206-341c-45c3-a639-24f724091a60 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:33.546236 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-0abd7206-341c-45c3-a639-24f724091a60 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:33.546686 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-0abd7206-341c-45c3-a639-24f724091a60 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:33.959100 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-399cd4a2-5d4c-4d54-b0f9-4103ede498a6 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbc8ad40b44661b526511ecbc51027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd44719e63bb947bdb13e9309d1576521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:33.973287 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-399cd4a2-5d4c-4d54-b0f9-4103ede498a6 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] 10.222.0.23 "GET /compute/v2.1/servers/fa6eab49-6809-41fa-96c5-a6297dbe51d6" status: 200 len: 1315 microversion: 2.1 time: 0.578995 Jul 12 13:28:33.973984 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 87/179] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:28:33 2022] GET /compute/v2.1/servers/fa6eab49-6809-41fa-96c5-a6297dbe51d6 => generated 1315 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:28:33.987708 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-0abd7206-341c-45c3-a639-24f724091a60 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:33.998319 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-0abd7206-341c-45c3-a639-24f724091a60 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:34.000028 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-0abd7206-341c-45c3-a639-24f724091a60 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:34.001681 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-0abd7206-341c-45c3-a639-24f724091a60 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f" status: 200 len: 1407 microversion: 2.20 time: 0.474845 Jul 12 13:28:34.002798 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 93/180] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:28:33 2022] GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f => generated 1407 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 13:28:34.087012 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-ddf464aa-a391-405d-889f-5a9a7ccb1749 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:28:34.087827 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-ddf464aa-a391-405d-889f-5a9a7ccb1749 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: 95edada5-d3ec-4056-99e9-379fb4b65394] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:28:34.094086 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-ddf464aa-a391-405d-889f-5a9a7ccb1749 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:34.095105 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-ddf464aa-a391-405d-889f-5a9a7ccb1749 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:34.096214 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-ddf464aa-a391-405d-889f-5a9a7ccb1749 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:34.097009 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-ddf464aa-a391-405d-889f-5a9a7ccb1749 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:34.253348 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-1986eeec-015f-4cfb-a2f1-45d4fb80dcd5 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:28:34.255085 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-1986eeec-015f-4cfb-a2f1-45d4fb80dcd5 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] [instance: eeb0b554-cd09-49b5-95f0-22fc7c707944] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:28:34.277689 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-1986eeec-015f-4cfb-a2f1-45d4fb80dcd5 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:34.278161 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-1986eeec-015f-4cfb-a2f1-45d4fb80dcd5 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:34.278951 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-1986eeec-015f-4cfb-a2f1-45d4fb80dcd5 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:34.279396 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-1986eeec-015f-4cfb-a2f1-45d4fb80dcd5 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:34.289239 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-ddf464aa-a391-405d-889f-5a9a7ccb1749 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f448776d1074e22bfe6cfbe05e01db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27fe465e6743e19feec424e6e9f3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:34.308244 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-ddf464aa-a391-405d-889f-5a9a7ccb1749 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394" status: 200 len: 1321 microversion: 2.1 time: 0.222134 Jul 12 13:28:34.319375 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 88/181] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:28:34 2022] GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394 => generated 1321 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:28:34.319747 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG dbcounter [-] [117988] Writing DB stats nova_cell1:SELECT=100 {{(pid=117988) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:34.494977 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-1986eeec-015f-4cfb-a2f1-45d4fb80dcd5 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b710bbdf0c4d58b4f3ee7ef7410c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8fca4ab6ed466a864c5551fea5f7ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:34.504915 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-1986eeec-015f-4cfb-a2f1-45d4fb80dcd5 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] 10.222.0.23 "GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944" status: 200 len: 1363 microversion: 2.1 time: 0.257191 Jul 12 13:28:34.505919 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 94/182] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:28:34 2022] GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944 => generated 1363 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:28:35.002541 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-2fbc34f3-90ce-40df-b50e-6b111f24c8b0 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:28:35.005814 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-2fbc34f3-90ce-40df-b50e-6b111f24c8b0 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] [instance: fa6eab49-6809-41fa-96c5-a6297dbe51d6] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:28:35.014332 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-2fbc34f3-90ce-40df-b50e-6b111f24c8b0 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:35.015403 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-2fbc34f3-90ce-40df-b50e-6b111f24c8b0 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:35.019562 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-2fbc34f3-90ce-40df-b50e-6b111f24c8b0 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:35.020527 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-2fbc34f3-90ce-40df-b50e-6b111f24c8b0 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:35.040462 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-b4da2203-1ed2-4dfd-bfe2-440276ae16b6 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:28:35.042780 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-b4da2203-1ed2-4dfd-bfe2-440276ae16b6 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 5d30ed54-909d-491f-a14c-bc4435cfdc6f] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:28:35.063883 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-b4da2203-1ed2-4dfd-bfe2-440276ae16b6 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:35.066532 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-b4da2203-1ed2-4dfd-bfe2-440276ae16b6 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:35.068433 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-b4da2203-1ed2-4dfd-bfe2-440276ae16b6 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:35.069643 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-b4da2203-1ed2-4dfd-bfe2-440276ae16b6 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:35.379436 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-2fbc34f3-90ce-40df-b50e-6b111f24c8b0 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbc8ad40b44661b526511ecbc51027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd44719e63bb947bdb13e9309d1576521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:35.407663 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-2fbc34f3-90ce-40df-b50e-6b111f24c8b0 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] 10.222.0.23 "GET /compute/v2.1/servers/fa6eab49-6809-41fa-96c5-a6297dbe51d6" status: 200 len: 1315 microversion: 2.1 time: 0.414610 Jul 12 13:28:35.411888 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 89/183] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:28:34 2022] GET /compute/v2.1/servers/fa6eab49-6809-41fa-96c5-a6297dbe51d6 => generated 1315 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:28:35.423574 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-9251333c-2091-46ec-b0c0-9556ce758786 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:28:35.425446 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-9251333c-2091-46ec-b0c0-9556ce758786 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: 95edada5-d3ec-4056-99e9-379fb4b65394] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:28:35.442632 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-9251333c-2091-46ec-b0c0-9556ce758786 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:35.444387 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-9251333c-2091-46ec-b0c0-9556ce758786 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:35.448482 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-9251333c-2091-46ec-b0c0-9556ce758786 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:35.449327 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-9251333c-2091-46ec-b0c0-9556ce758786 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:35.483366 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-b4da2203-1ed2-4dfd-bfe2-440276ae16b6 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:35.521860 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-b4da2203-1ed2-4dfd-bfe2-440276ae16b6 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:35.524221 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-b4da2203-1ed2-4dfd-bfe2-440276ae16b6 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:35.531827 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-b4da2203-1ed2-4dfd-bfe2-440276ae16b6 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f" status: 200 len: 1407 microversion: 2.20 time: 0.500878 Jul 12 13:28:35.532676 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 95/184] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:28:35 2022] GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f => generated 1407 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 13:28:35.550594 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-f0e32eb7-430a-487c-af5d-2b1635fc22ab tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:28:35.551605 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-f0e32eb7-430a-487c-af5d-2b1635fc22ab tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] [instance: eeb0b554-cd09-49b5-95f0-22fc7c707944] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:28:35.558824 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-f0e32eb7-430a-487c-af5d-2b1635fc22ab tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:35.559680 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-f0e32eb7-430a-487c-af5d-2b1635fc22ab tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:35.560894 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-f0e32eb7-430a-487c-af5d-2b1635fc22ab tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:35.561512 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-f0e32eb7-430a-487c-af5d-2b1635fc22ab tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:35.676977 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-9251333c-2091-46ec-b0c0-9556ce758786 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f448776d1074e22bfe6cfbe05e01db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27fe465e6743e19feec424e6e9f3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:35.687342 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-9251333c-2091-46ec-b0c0-9556ce758786 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394" status: 200 len: 1321 microversion: 2.1 time: 0.273393 Jul 12 13:28:35.758527 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 90/185] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:28:35 2022] GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394 => generated 1321 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:28:36.151324 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-f0e32eb7-430a-487c-af5d-2b1635fc22ab tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b710bbdf0c4d58b4f3ee7ef7410c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8fca4ab6ed466a864c5551fea5f7ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:36.168100 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-f0e32eb7-430a-487c-af5d-2b1635fc22ab tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] 10.222.0.23 "GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944" status: 200 len: 1363 microversion: 2.1 time: 0.633074 Jul 12 13:28:36.176096 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 96/186] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:28:35 2022] GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944 => generated 1363 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:28:36.377937 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [req-057e9b7d-147e-4cab-a201-b98683a0b80d req-98f30b2e-e4b3-4963-9d73-1b9a1e61aa94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf8dbed9-b15d-4daf-af11-7ee001424482", "name": "network-vif-plugged", "status": "completed", "tag": "e63ff95a-51aa-4e9d-85c0-b21397806ede"}]} {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:28:36.399398 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [req-057e9b7d-147e-4cab-a201-b98683a0b80d req-98f30b2e-e4b3-4963-9d73-1b9a1e61aa94 service nova] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:36.400342 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [req-057e9b7d-147e-4cab-a201-b98683a0b80d req-98f30b2e-e4b3-4963-9d73-1b9a1e61aa94 service nova] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:36.440656 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.compute.server_external_events [req-057e9b7d-147e-4cab-a201-b98683a0b80d req-98f30b2e-e4b3-4963-9d73-1b9a1e61aa94 service nova] Creating event network-vif-plugged:e63ff95a-51aa-4e9d-85c0-b21397806ede for instance bf8dbed9-b15d-4daf-af11-7ee001424482 on hv-cinder-82002 Jul 12 13:28:36.444610 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-83853a6d-ffe5-4190-8153-c1852f6ae91d tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:28:36.445535 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-83853a6d-ffe5-4190-8153-c1852f6ae91d tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] [instance: fa6eab49-6809-41fa-96c5-a6297dbe51d6] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:28:36.450343 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [req-057e9b7d-147e-4cab-a201-b98683a0b80d req-98f30b2e-e4b3-4963-9d73-1b9a1e61aa94 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081574 Jul 12 13:28:36.452467 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 91/187] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 12 13:28:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 13:28:36.457511 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-83853a6d-ffe5-4190-8153-c1852f6ae91d tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:36.458548 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-83853a6d-ffe5-4190-8153-c1852f6ae91d tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:36.460358 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-83853a6d-ffe5-4190-8153-c1852f6ae91d tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:36.462623 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-83853a6d-ffe5-4190-8153-c1852f6ae91d tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:36.560791 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-6d55d954-73f4-4ead-bfca-82686174532e tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:28:36.561823 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-6d55d954-73f4-4ead-bfca-82686174532e tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 5d30ed54-909d-491f-a14c-bc4435cfdc6f] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:28:36.581111 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-6d55d954-73f4-4ead-bfca-82686174532e tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:36.597102 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-6d55d954-73f4-4ead-bfca-82686174532e tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:36.600645 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-6d55d954-73f4-4ead-bfca-82686174532e tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:36.601074 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-6d55d954-73f4-4ead-bfca-82686174532e tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:37.011199 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-6d55d954-73f4-4ead-bfca-82686174532e tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:37.028303 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-6d55d954-73f4-4ead-bfca-82686174532e tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:37.038823 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-6d55d954-73f4-4ead-bfca-82686174532e tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:37.050556 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-6d55d954-73f4-4ead-bfca-82686174532e tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f" status: 200 len: 1407 microversion: 2.20 time: 0.495075 Jul 12 13:28:37.054797 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 92/188] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:28:36 2022] GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f => generated 1407 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 13:28:37.062066 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-83853a6d-ffe5-4190-8153-c1852f6ae91d tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbc8ad40b44661b526511ecbc51027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd44719e63bb947bdb13e9309d1576521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:37.082723 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-74bdfdb1-586a-4bb1-80ad-372b93744028 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:28:37.083505 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-74bdfdb1-586a-4bb1-80ad-372b93744028 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: 95edada5-d3ec-4056-99e9-379fb4b65394] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:28:37.088264 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-83853a6d-ffe5-4190-8153-c1852f6ae91d tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] 10.222.0.23 "GET /compute/v2.1/servers/fa6eab49-6809-41fa-96c5-a6297dbe51d6" status: 200 len: 1315 microversion: 2.1 time: 0.655496 Jul 12 13:28:37.089204 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 97/189] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:28:36 2022] GET /compute/v2.1/servers/fa6eab49-6809-41fa-96c5-a6297dbe51d6 => generated 1315 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:28:37.117338 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-74bdfdb1-586a-4bb1-80ad-372b93744028 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:37.118089 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-74bdfdb1-586a-4bb1-80ad-372b93744028 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:37.119204 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-74bdfdb1-586a-4bb1-80ad-372b93744028 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:37.121114 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-74bdfdb1-586a-4bb1-80ad-372b93744028 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:37.190990 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-03e32f13-eb6b-4fe9-b310-d17c634310db tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:28:37.191893 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-03e32f13-eb6b-4fe9-b310-d17c634310db tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] [instance: eeb0b554-cd09-49b5-95f0-22fc7c707944] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:28:37.204576 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-03e32f13-eb6b-4fe9-b310-d17c634310db tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:37.205036 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-03e32f13-eb6b-4fe9-b310-d17c634310db tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:37.210988 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-03e32f13-eb6b-4fe9-b310-d17c634310db tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:37.211442 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-03e32f13-eb6b-4fe9-b310-d17c634310db tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:37.492863 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-74bdfdb1-586a-4bb1-80ad-372b93744028 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f448776d1074e22bfe6cfbe05e01db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27fe465e6743e19feec424e6e9f3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:37.511403 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-74bdfdb1-586a-4bb1-80ad-372b93744028 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394" status: 200 len: 1321 microversion: 2.1 time: 0.454292 Jul 12 13:28:37.512927 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 93/190] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:28:37 2022] GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394 => generated 1321 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:28:37.522946 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-03e32f13-eb6b-4fe9-b310-d17c634310db tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b710bbdf0c4d58b4f3ee7ef7410c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8fca4ab6ed466a864c5551fea5f7ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:37.544184 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-03e32f13-eb6b-4fe9-b310-d17c634310db tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] 10.222.0.23 "GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944" status: 200 len: 1363 microversion: 2.1 time: 0.356762 Jul 12 13:28:37.551561 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 98/191] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:28:37 2022] GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944 => generated 1363 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:28:38.090598 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-f74bfcc9-9c77-4575-a888-09a2e4f8d5df tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:28:38.093159 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-f74bfcc9-9c77-4575-a888-09a2e4f8d5df tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 5d30ed54-909d-491f-a14c-bc4435cfdc6f] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:28:38.101579 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-f74bfcc9-9c77-4575-a888-09a2e4f8d5df tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:38.102380 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-f74bfcc9-9c77-4575-a888-09a2e4f8d5df tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:38.103912 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-f74bfcc9-9c77-4575-a888-09a2e4f8d5df tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:38.104944 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-f74bfcc9-9c77-4575-a888-09a2e4f8d5df tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:38.116959 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-ec2d5f66-c40b-4ee3-8c50-68b88cdb1e43 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:28:38.119574 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-ec2d5f66-c40b-4ee3-8c50-68b88cdb1e43 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] [instance: fa6eab49-6809-41fa-96c5-a6297dbe51d6] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:28:38.135522 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-ec2d5f66-c40b-4ee3-8c50-68b88cdb1e43 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:38.136397 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-ec2d5f66-c40b-4ee3-8c50-68b88cdb1e43 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:38.137948 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-ec2d5f66-c40b-4ee3-8c50-68b88cdb1e43 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:38.138888 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-ec2d5f66-c40b-4ee3-8c50-68b88cdb1e43 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:38.648952 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-f74bfcc9-9c77-4575-a888-09a2e4f8d5df tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:38.658265 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-f74bfcc9-9c77-4575-a888-09a2e4f8d5df tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:38.661043 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-f74bfcc9-9c77-4575-a888-09a2e4f8d5df tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:38.670266 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-f74bfcc9-9c77-4575-a888-09a2e4f8d5df tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f" status: 200 len: 1600 microversion: 2.20 time: 0.591008 Jul 12 13:28:38.671358 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 94/192] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:28:38 2022] GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f => generated 1600 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:28:38.681037 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [req-24a48061-a410-4029-81b3-a791a67d79d5 req-0d2f35cc-cf2b-49f7-b9cf-dcad887b6ef5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa6eab49-6809-41fa-96c5-a6297dbe51d6", "name": "network-vif-plugged", "status": "completed", "tag": "1ae19672-01e9-412a-846d-c5a3eb239196"}]} {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:28:38.695703 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [req-24a48061-a410-4029-81b3-a791a67d79d5 req-0d2f35cc-cf2b-49f7-b9cf-dcad887b6ef5 service nova] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:38.696815 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [req-24a48061-a410-4029-81b3-a791a67d79d5 req-0d2f35cc-cf2b-49f7-b9cf-dcad887b6ef5 service nova] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:38.713078 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-ec2d5f66-c40b-4ee3-8c50-68b88cdb1e43 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbc8ad40b44661b526511ecbc51027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd44719e63bb947bdb13e9309d1576521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:38.716664 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.compute.server_external_events [req-24a48061-a410-4029-81b3-a791a67d79d5 req-0d2f35cc-cf2b-49f7-b9cf-dcad887b6ef5 service nova] Creating event network-vif-plugged:1ae19672-01e9-412a-846d-c5a3eb239196 for instance fa6eab49-6809-41fa-96c5-a6297dbe51d6 on hv-cinder-82002 Jul 12 13:28:38.735803 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [req-24a48061-a410-4029-81b3-a791a67d79d5 req-0d2f35cc-cf2b-49f7-b9cf-dcad887b6ef5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062964 Jul 12 13:28:38.738747 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 95/193] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 12 13:28:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:28:38.747364 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-8c2197eb-8b5c-41a9-9d53-cf1ea9226184 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:28:38.750230 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-8c2197eb-8b5c-41a9-9d53-cf1ea9226184 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: 95edada5-d3ec-4056-99e9-379fb4b65394] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:28:38.750870 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-ec2d5f66-c40b-4ee3-8c50-68b88cdb1e43 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] 10.222.0.23 "GET /compute/v2.1/servers/fa6eab49-6809-41fa-96c5-a6297dbe51d6" status: 200 len: 1315 microversion: 2.1 time: 0.637846 Jul 12 13:28:38.752055 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 99/194] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:28:38 2022] GET /compute/v2.1/servers/fa6eab49-6809-41fa-96c5-a6297dbe51d6 => generated 1315 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:28:38.775424 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-dacd7a3c-4c9e-4003-b81b-03162c80d5ac tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:28:38.782075 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-dacd7a3c-4c9e-4003-b81b-03162c80d5ac tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] [instance: eeb0b554-cd09-49b5-95f0-22fc7c707944] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:28:38.790568 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-dacd7a3c-4c9e-4003-b81b-03162c80d5ac tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:38.791192 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-dacd7a3c-4c9e-4003-b81b-03162c80d5ac tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:38.792392 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-dacd7a3c-4c9e-4003-b81b-03162c80d5ac tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:38.792997 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-dacd7a3c-4c9e-4003-b81b-03162c80d5ac tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:38.799726 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-8c2197eb-8b5c-41a9-9d53-cf1ea9226184 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:38.800458 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-8c2197eb-8b5c-41a9-9d53-cf1ea9226184 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:38.801635 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-8c2197eb-8b5c-41a9-9d53-cf1ea9226184 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:38.803405 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-8c2197eb-8b5c-41a9-9d53-cf1ea9226184 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:39.014460 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-dacd7a3c-4c9e-4003-b81b-03162c80d5ac tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b710bbdf0c4d58b4f3ee7ef7410c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8fca4ab6ed466a864c5551fea5f7ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:39.050298 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-dacd7a3c-4c9e-4003-b81b-03162c80d5ac tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] 10.222.0.23 "GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944" status: 200 len: 1550 microversion: 2.1 time: 0.289114 Jul 12 13:28:39.051962 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 100/195] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:28:38 2022] GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944 => generated 1550 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:28:39.061596 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-628fa308-8c10-454a-ab95-c2604aa091ea tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:28:39.063174 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-628fa308-8c10-454a-ab95-c2604aa091ea tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 5d30ed54-909d-491f-a14c-bc4435cfdc6f] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:28:39.081371 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-628fa308-8c10-454a-ab95-c2604aa091ea tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:39.083270 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-628fa308-8c10-454a-ab95-c2604aa091ea tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:39.084718 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-628fa308-8c10-454a-ab95-c2604aa091ea tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:39.086225 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-628fa308-8c10-454a-ab95-c2604aa091ea tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:39.104837 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-8c2197eb-8b5c-41a9-9d53-cf1ea9226184 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f448776d1074e22bfe6cfbe05e01db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27fe465e6743e19feec424e6e9f3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:39.114359 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-8c2197eb-8b5c-41a9-9d53-cf1ea9226184 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394" status: 200 len: 1321 microversion: 2.1 time: 0.372115 Jul 12 13:28:39.129348 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 96/196] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:28:38 2022] GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394 => generated 1321 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:28:39.142302 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-77b906a1-1b9f-4494-86b9-96c3da4b448b tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:28:39.148523 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-77b906a1-1b9f-4494-86b9-96c3da4b448b tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] [instance: eeb0b554-cd09-49b5-95f0-22fc7c707944] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:28:39.156788 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-77b906a1-1b9f-4494-86b9-96c3da4b448b tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:39.157719 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-77b906a1-1b9f-4494-86b9-96c3da4b448b tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:39.159480 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-77b906a1-1b9f-4494-86b9-96c3da4b448b tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:39.160309 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-77b906a1-1b9f-4494-86b9-96c3da4b448b tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:39.222212 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG dbcounter [-] [117987] Writing DB stats nova_cell1:SELECT=100 {{(pid=117987) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:39.332120 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-628fa308-8c10-454a-ab95-c2604aa091ea tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.277899 Jul 12 13:28:39.333092 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 101/197] 10.222.0.23 () {60 vars in 1315 bytes} [Tue Jul 12 13:28:39 2022] GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f/os-interface => generated 285 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 13:28:39.364859 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-77b906a1-1b9f-4494-86b9-96c3da4b448b tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] 10.222.0.23 "GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.233488 Jul 12 13:28:39.372633 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 97/198] 10.222.0.23 () {58 vars in 1274 bytes} [Tue Jul 12 13:28:39 2022] GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944/os-interface => generated 285 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:28:39.773316 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-09ec8e83-b524-478a-ba86-c2af9666c7f0 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:28:39.774277 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-09ec8e83-b524-478a-ba86-c2af9666c7f0 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] [instance: fa6eab49-6809-41fa-96c5-a6297dbe51d6] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:28:39.805499 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-09ec8e83-b524-478a-ba86-c2af9666c7f0 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:39.809191 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-09ec8e83-b524-478a-ba86-c2af9666c7f0 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:39.816752 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-09ec8e83-b524-478a-ba86-c2af9666c7f0 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:39.819543 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-09ec8e83-b524-478a-ba86-c2af9666c7f0 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:40.137041 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-2b926104-97d6-4107-9546-7a1ba0c88708 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:28:40.137891 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-2b926104-97d6-4107-9546-7a1ba0c88708 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: 95edada5-d3ec-4056-99e9-379fb4b65394] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:28:40.151768 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-2b926104-97d6-4107-9546-7a1ba0c88708 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:40.152507 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-2b926104-97d6-4107-9546-7a1ba0c88708 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:40.155112 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-2b926104-97d6-4107-9546-7a1ba0c88708 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:40.155789 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-2b926104-97d6-4107-9546-7a1ba0c88708 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:40.836823 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-09ec8e83-b524-478a-ba86-c2af9666c7f0 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbc8ad40b44661b526511ecbc51027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd44719e63bb947bdb13e9309d1576521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:40.847015 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-09ec8e83-b524-478a-ba86-c2af9666c7f0 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] 10.222.0.23 "GET /compute/v2.1/servers/fa6eab49-6809-41fa-96c5-a6297dbe51d6" status: 200 len: 1315 microversion: 2.1 time: 1.081069 Jul 12 13:28:40.861632 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 102/199] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:28:39 2022] GET /compute/v2.1/servers/fa6eab49-6809-41fa-96c5-a6297dbe51d6 => generated 1315 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:28:40.867223 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [req-43bb0b2f-149b-4207-a26b-1478a4372d2b req-a32c39ff-e0ee-4018-80fe-0f0a151801c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95edada5-d3ec-4056-99e9-379fb4b65394", "name": "network-vif-plugged", "status": "completed", "tag": "46dc7639-cc9b-48c0-9d26-acdc89e2058e"}]} {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:28:40.887792 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [req-43bb0b2f-149b-4207-a26b-1478a4372d2b req-a32c39ff-e0ee-4018-80fe-0f0a151801c1 service nova] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:40.888240 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [req-43bb0b2f-149b-4207-a26b-1478a4372d2b req-a32c39ff-e0ee-4018-80fe-0f0a151801c1 service nova] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:40.904266 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.compute.server_external_events [req-43bb0b2f-149b-4207-a26b-1478a4372d2b req-a32c39ff-e0ee-4018-80fe-0f0a151801c1 service nova] Creating event network-vif-plugged:46dc7639-cc9b-48c0-9d26-acdc89e2058e for instance 95edada5-d3ec-4056-99e9-379fb4b65394 on hv-cinder-82002 Jul 12 13:28:40.923962 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [req-43bb0b2f-149b-4207-a26b-1478a4372d2b req-a32c39ff-e0ee-4018-80fe-0f0a151801c1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071117 Jul 12 13:28:40.925223 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 103/200] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 12 13:28:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:28:41.003602 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-2b926104-97d6-4107-9546-7a1ba0c88708 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f448776d1074e22bfe6cfbe05e01db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27fe465e6743e19feec424e6e9f3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:41.015307 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-2b926104-97d6-4107-9546-7a1ba0c88708 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394" status: 200 len: 1321 microversion: 2.1 time: 0.882817 Jul 12 13:28:41.016155 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 98/201] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:28:40 2022] GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394 => generated 1321 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:28:41.687227 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [req-e8ccaea1-0126-4899-90f7-d266180b7bc1 req-7858d20f-ea6e-448b-b0f9-8e9dd30a73e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d30ed54-909d-491f-a14c-bc4435cfdc6f", "tag": "f13aa237-fefb-4e93-8923-7007031116c1"}]} {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:28:41.725850 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [req-e8ccaea1-0126-4899-90f7-d266180b7bc1 req-7858d20f-ea6e-448b-b0f9-8e9dd30a73e8 service nova] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:41.727906 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [req-e8ccaea1-0126-4899-90f7-d266180b7bc1 req-7858d20f-ea6e-448b-b0f9-8e9dd30a73e8 service nova] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:41.751301 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.compute.server_external_events [req-e8ccaea1-0126-4899-90f7-d266180b7bc1 req-7858d20f-ea6e-448b-b0f9-8e9dd30a73e8 service nova] Creating event network-changed:f13aa237-fefb-4e93-8923-7007031116c1 for instance 5d30ed54-909d-491f-a14c-bc4435cfdc6f on hv-cinder-82002 Jul 12 13:28:41.766644 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [req-e8ccaea1-0126-4899-90f7-d266180b7bc1 req-7858d20f-ea6e-448b-b0f9-8e9dd30a73e8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086787 Jul 12 13:28:41.767725 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 104/202] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 12 13:28:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:28:41.881334 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-2998faf2-bee9-4089-9d25-f8d3f2fed348 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:28:41.882161 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-2998faf2-bee9-4089-9d25-f8d3f2fed348 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] [instance: fa6eab49-6809-41fa-96c5-a6297dbe51d6] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:28:41.901361 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-2998faf2-bee9-4089-9d25-f8d3f2fed348 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:41.902002 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-2998faf2-bee9-4089-9d25-f8d3f2fed348 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:41.903603 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-2998faf2-bee9-4089-9d25-f8d3f2fed348 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:41.907359 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-2998faf2-bee9-4089-9d25-f8d3f2fed348 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:42.044975 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-cfc90b5e-a374-4008-b38f-88bc06df79c3 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:28:42.048020 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-cfc90b5e-a374-4008-b38f-88bc06df79c3 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: 95edada5-d3ec-4056-99e9-379fb4b65394] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:28:42.076424 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-cfc90b5e-a374-4008-b38f-88bc06df79c3 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:42.077233 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-cfc90b5e-a374-4008-b38f-88bc06df79c3 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:42.080970 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-cfc90b5e-a374-4008-b38f-88bc06df79c3 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:42.086841 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-cfc90b5e-a374-4008-b38f-88bc06df79c3 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:42.862613 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-2998faf2-bee9-4089-9d25-f8d3f2fed348 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbc8ad40b44661b526511ecbc51027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd44719e63bb947bdb13e9309d1576521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:42.887926 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-2998faf2-bee9-4089-9d25-f8d3f2fed348 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] 10.222.0.23 "GET /compute/v2.1/servers/fa6eab49-6809-41fa-96c5-a6297dbe51d6" status: 200 len: 1315 microversion: 2.1 time: 1.014457 Jul 12 13:28:42.889914 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 99/203] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:28:41 2022] GET /compute/v2.1/servers/fa6eab49-6809-41fa-96c5-a6297dbe51d6 => generated 1315 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:28:43.000386 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [req-96ef94c2-32de-4711-9283-206444c8647f req-d466a9e7-db59-4211-b3e2-f25f795a46ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eeb0b554-cd09-49b5-95f0-22fc7c707944", "tag": "1611c489-7c46-47eb-9b57-cd5d00147d26"}]} {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:28:43.024753 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [req-96ef94c2-32de-4711-9283-206444c8647f req-d466a9e7-db59-4211-b3e2-f25f795a46ef service nova] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:43.026559 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [req-96ef94c2-32de-4711-9283-206444c8647f req-d466a9e7-db59-4211-b3e2-f25f795a46ef service nova] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:43.066527 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.compute.server_external_events [req-96ef94c2-32de-4711-9283-206444c8647f req-d466a9e7-db59-4211-b3e2-f25f795a46ef service nova] Creating event network-changed:1611c489-7c46-47eb-9b57-cd5d00147d26 for instance eeb0b554-cd09-49b5-95f0-22fc7c707944 on hv-cinder-82002 Jul 12 13:28:43.087385 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [req-96ef94c2-32de-4711-9283-206444c8647f req-d466a9e7-db59-4211-b3e2-f25f795a46ef service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090100 Jul 12 13:28:43.092225 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 100/204] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 12 13:28:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Jul 12 13:28:43.101669 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-cfc90b5e-a374-4008-b38f-88bc06df79c3 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f448776d1074e22bfe6cfbe05e01db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27fe465e6743e19feec424e6e9f3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:43.119410 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-cfc90b5e-a374-4008-b38f-88bc06df79c3 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394" status: 200 len: 1321 microversion: 2.1 time: 1.088778 Jul 12 13:28:43.132905 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 105/205] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:28:42 2022] GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394 => generated 1321 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:28:43.917686 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-61ffe076-f04b-4d68-8aa9-a6632ecc10df tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:28:43.918942 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-61ffe076-f04b-4d68-8aa9-a6632ecc10df tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] [instance: fa6eab49-6809-41fa-96c5-a6297dbe51d6] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:28:43.929775 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-61ffe076-f04b-4d68-8aa9-a6632ecc10df tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:43.930506 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-61ffe076-f04b-4d68-8aa9-a6632ecc10df tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:43.931460 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-61ffe076-f04b-4d68-8aa9-a6632ecc10df tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:43.932055 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-61ffe076-f04b-4d68-8aa9-a6632ecc10df tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:44.140235 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-876de95a-84a4-4122-aa4a-fa5aa30fac3d tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:28:44.142123 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-876de95a-84a4-4122-aa4a-fa5aa30fac3d tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: 95edada5-d3ec-4056-99e9-379fb4b65394] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:28:44.174736 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-876de95a-84a4-4122-aa4a-fa5aa30fac3d tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:44.175766 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-876de95a-84a4-4122-aa4a-fa5aa30fac3d tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:44.180453 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-876de95a-84a4-4122-aa4a-fa5aa30fac3d tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:44.181267 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-876de95a-84a4-4122-aa4a-fa5aa30fac3d tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:44.933138 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-61ffe076-f04b-4d68-8aa9-a6632ecc10df tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbc8ad40b44661b526511ecbc51027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd44719e63bb947bdb13e9309d1576521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:44.952585 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-61ffe076-f04b-4d68-8aa9-a6632ecc10df tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] 10.222.0.23 "GET /compute/v2.1/servers/fa6eab49-6809-41fa-96c5-a6297dbe51d6" status: 200 len: 1502 microversion: 2.1 time: 1.037058 Jul 12 13:28:44.974651 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-876de95a-84a4-4122-aa4a-fa5aa30fac3d tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f448776d1074e22bfe6cfbe05e01db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27fe465e6743e19feec424e6e9f3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:44.985907 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-876de95a-84a4-4122-aa4a-fa5aa30fac3d tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394" status: 200 len: 1321 microversion: 2.1 time: 0.848350 Jul 12 13:28:44.988715 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 106/206] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:28:44 2022] GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394 => generated 1321 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:28:44.989771 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 101/207] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:28:43 2022] GET /compute/v2.1/servers/fa6eab49-6809-41fa-96c5-a6297dbe51d6 => generated 1502 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:28:46.007277 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-af714a69-e48d-419a-bec3-d697674b03e0 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:28:46.008886 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-af714a69-e48d-419a-bec3-d697674b03e0 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: 95edada5-d3ec-4056-99e9-379fb4b65394] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:28:46.022815 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-af714a69-e48d-419a-bec3-d697674b03e0 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:46.025597 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-af714a69-e48d-419a-bec3-d697674b03e0 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:46.027917 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-af714a69-e48d-419a-bec3-d697674b03e0 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:46.029944 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-af714a69-e48d-419a-bec3-d697674b03e0 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:46.473483 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-af714a69-e48d-419a-bec3-d697674b03e0 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f448776d1074e22bfe6cfbe05e01db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27fe465e6743e19feec424e6e9f3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:46.485665 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-af714a69-e48d-419a-bec3-d697674b03e0 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394" status: 200 len: 1515 microversion: 2.1 time: 0.482411 Jul 12 13:28:46.487336 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 107/208] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:28:46 2022] GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394 => generated 1515 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:28:46.505248 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-e32e1d85-f216-4c8c-9488-9af861d8f2eb tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:28:46.509023 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-e32e1d85-f216-4c8c-9488-9af861d8f2eb tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: 95edada5-d3ec-4056-99e9-379fb4b65394] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:28:46.515429 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-e32e1d85-f216-4c8c-9488-9af861d8f2eb tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:46.515880 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-e32e1d85-f216-4c8c-9488-9af861d8f2eb tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:46.516837 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-e32e1d85-f216-4c8c-9488-9af861d8f2eb tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:46.518549 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-e32e1d85-f216-4c8c-9488-9af861d8f2eb tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:46.542366 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.objects.instance [None req-e32e1d85-f216-4c8c-9488-9af861d8f2eb tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lazy-loading 'flavor' on Instance uuid 95edada5-d3ec-4056-99e9-379fb4b65394 {{(pid=117987) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 13:28:46.680874 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-e32e1d85-f216-4c8c-9488-9af861d8f2eb tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "POST /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394/action" status: 200 len: 32 microversion: 2.1 time: 0.180872 Jul 12 13:28:46.681789 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 102/209] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 12 13:28:46 2022] POST /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394/action => generated 32 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 12 13:28:46.691994 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-6c888f97-d106-45b8-a98e-c755e812a5f8 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:28:46.693431 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-6c888f97-d106-45b8-a98e-c755e812a5f8 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: 95edada5-d3ec-4056-99e9-379fb4b65394] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:28:46.701310 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-6c888f97-d106-45b8-a98e-c755e812a5f8 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:46.702117 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-6c888f97-d106-45b8-a98e-c755e812a5f8 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:46.703637 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-6c888f97-d106-45b8-a98e-c755e812a5f8 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:46.704526 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-6c888f97-d106-45b8-a98e-c755e812a5f8 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:46.825786 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-ffbfa60d-0921-4742-a82a-44abbb341822 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "88a00da6-03cd-4d7b-b9f3-744c0af2db9d"}} {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:28:46.827337 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-ffbfa60d-0921-4742-a82a-44abbb341822 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] [instance: fa6eab49-6809-41fa-96c5-a6297dbe51d6] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:28:46.836771 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-ffbfa60d-0921-4742-a82a-44abbb341822 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:46.837757 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-ffbfa60d-0921-4742-a82a-44abbb341822 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:46.838552 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-ffbfa60d-0921-4742-a82a-44abbb341822 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:46.838988 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-ffbfa60d-0921-4742-a82a-44abbb341822 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:46.920321 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-6c888f97-d106-45b8-a98e-c755e812a5f8 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f448776d1074e22bfe6cfbe05e01db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27fe465e6743e19feec424e6e9f3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:46.928796 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-6c888f97-d106-45b8-a98e-c755e812a5f8 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394" status: 200 len: 1521 microversion: 2.1 time: 0.241600 Jul 12 13:28:46.929489 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 108/210] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:28:46 2022] GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394 => generated 1521 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:28:47.243652 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-ffbfa60d-0921-4742-a82a-44abbb341822 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] 10.222.0.23 "POST /compute/v2.1/servers/fa6eab49-6809-41fa-96c5-a6297dbe51d6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.421969 Jul 12 13:28:47.244641 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 103/211] 10.222.0.23 () {60 vars in 1322 bytes} [Tue Jul 12 13:28:46 2022] POST /compute/v2.1/servers/fa6eab49-6809-41fa-96c5-a6297dbe51d6/os-volume_attachments => generated 194 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 13:28:47.946133 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-e034d642-34b6-4a17-bb15-9c0a31b92d26 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:28:47.946654 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-e034d642-34b6-4a17-bb15-9c0a31b92d26 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: 95edada5-d3ec-4056-99e9-379fb4b65394] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:28:47.953547 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-e034d642-34b6-4a17-bb15-9c0a31b92d26 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:47.953703 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-e034d642-34b6-4a17-bb15-9c0a31b92d26 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:47.954406 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-e034d642-34b6-4a17-bb15-9c0a31b92d26 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:47.954859 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-e034d642-34b6-4a17-bb15-9c0a31b92d26 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:48.161365 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-e034d642-34b6-4a17-bb15-9c0a31b92d26 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f448776d1074e22bfe6cfbe05e01db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27fe465e6743e19feec424e6e9f3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:48.178218 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-e034d642-34b6-4a17-bb15-9c0a31b92d26 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394" status: 200 len: 1521 microversion: 2.1 time: 0.235860 Jul 12 13:28:48.179356 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 109/212] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:28:47 2022] GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394 => generated 1521 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:28:49.201322 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-93983ab3-426b-403d-8b8f-8a9fdfeee975 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:28:49.202078 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-93983ab3-426b-403d-8b8f-8a9fdfeee975 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: 95edada5-d3ec-4056-99e9-379fb4b65394] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:28:49.209934 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-93983ab3-426b-403d-8b8f-8a9fdfeee975 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:49.210533 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-93983ab3-426b-403d-8b8f-8a9fdfeee975 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:49.211591 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-93983ab3-426b-403d-8b8f-8a9fdfeee975 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:49.212084 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-93983ab3-426b-403d-8b8f-8a9fdfeee975 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:49.418136 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-93983ab3-426b-403d-8b8f-8a9fdfeee975 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f448776d1074e22bfe6cfbe05e01db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27fe465e6743e19feec424e6e9f3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:49.426894 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-93983ab3-426b-403d-8b8f-8a9fdfeee975 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394" status: 200 len: 1521 microversion: 2.1 time: 0.230545 Jul 12 13:28:49.427374 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 104/213] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:28:49 2022] GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394 => generated 1521 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:28:50.446055 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-8c6bbc41-41d0-43a6-b2c3-42637c3ba5c7 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:28:50.446712 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-8c6bbc41-41d0-43a6-b2c3-42637c3ba5c7 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: 95edada5-d3ec-4056-99e9-379fb4b65394] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:28:50.453726 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-8c6bbc41-41d0-43a6-b2c3-42637c3ba5c7 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:50.454184 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-8c6bbc41-41d0-43a6-b2c3-42637c3ba5c7 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:50.455760 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-8c6bbc41-41d0-43a6-b2c3-42637c3ba5c7 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:50.456421 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-8c6bbc41-41d0-43a6-b2c3-42637c3ba5c7 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:50.670599 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-8c6bbc41-41d0-43a6-b2c3-42637c3ba5c7 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f448776d1074e22bfe6cfbe05e01db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27fe465e6743e19feec424e6e9f3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:50.679651 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-8c6bbc41-41d0-43a6-b2c3-42637c3ba5c7 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394" status: 200 len: 1521 microversion: 2.1 time: 0.238163 Jul 12 13:28:50.680754 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 110/214] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:28:50 2022] GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394 => generated 1521 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:28:51.697704 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-d52d5501-eaa5-4216-acbd-01f7dd5c8360 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:28:51.698565 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-d52d5501-eaa5-4216-acbd-01f7dd5c8360 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: 95edada5-d3ec-4056-99e9-379fb4b65394] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:28:51.705522 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-d52d5501-eaa5-4216-acbd-01f7dd5c8360 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:51.705983 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-d52d5501-eaa5-4216-acbd-01f7dd5c8360 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:51.706767 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-d52d5501-eaa5-4216-acbd-01f7dd5c8360 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:51.707203 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-d52d5501-eaa5-4216-acbd-01f7dd5c8360 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:51.872136 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-d52d5501-eaa5-4216-acbd-01f7dd5c8360 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f448776d1074e22bfe6cfbe05e01db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27fe465e6743e19feec424e6e9f3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:51.881472 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-d52d5501-eaa5-4216-acbd-01f7dd5c8360 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394" status: 200 len: 1521 microversion: 2.1 time: 0.187357 Jul 12 13:28:51.883000 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 105/215] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:28:51 2022] GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394 => generated 1521 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:28:52.912377 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-6ee62be1-b823-423d-9bf8-678a1c123aa8 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:28:52.912914 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-6ee62be1-b823-423d-9bf8-678a1c123aa8 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: 95edada5-d3ec-4056-99e9-379fb4b65394] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:28:52.920596 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-6ee62be1-b823-423d-9bf8-678a1c123aa8 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:52.921042 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-6ee62be1-b823-423d-9bf8-678a1c123aa8 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:52.921851 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-6ee62be1-b823-423d-9bf8-678a1c123aa8 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:52.922287 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-6ee62be1-b823-423d-9bf8-678a1c123aa8 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:53.071115 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-6ee62be1-b823-423d-9bf8-678a1c123aa8 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f448776d1074e22bfe6cfbe05e01db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27fe465e6743e19feec424e6e9f3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:53.078778 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-6ee62be1-b823-423d-9bf8-678a1c123aa8 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394" status: 200 len: 1521 microversion: 2.1 time: 0.170439 Jul 12 13:28:53.079382 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 111/216] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:28:52 2022] GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394 => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:28:54.099218 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-12045d2f-daac-45bb-9e1c-8d3db0721e6f tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:28:54.100008 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-12045d2f-daac-45bb-9e1c-8d3db0721e6f tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: 95edada5-d3ec-4056-99e9-379fb4b65394] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:28:54.103151 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG dbcounter [-] [117987] Writing DB stats nova_api:SELECT=68 {{(pid=117987) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:54.108887 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-12045d2f-daac-45bb-9e1c-8d3db0721e6f tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:54.109351 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-12045d2f-daac-45bb-9e1c-8d3db0721e6f tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:54.110176 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-12045d2f-daac-45bb-9e1c-8d3db0721e6f tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:54.110611 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-12045d2f-daac-45bb-9e1c-8d3db0721e6f tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:54.261045 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-12045d2f-daac-45bb-9e1c-8d3db0721e6f tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f448776d1074e22bfe6cfbe05e01db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27fe465e6743e19feec424e6e9f3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:54.269164 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-12045d2f-daac-45bb-9e1c-8d3db0721e6f tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394" status: 200 len: 1521 microversion: 2.1 time: 0.175778 Jul 12 13:28:54.269760 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 106/217] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:28:54 2022] GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394 => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:28:55.285712 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-9413ff15-b60b-4857-90b5-9f15383dd40b tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:28:55.286321 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-9413ff15-b60b-4857-90b5-9f15383dd40b tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: 95edada5-d3ec-4056-99e9-379fb4b65394] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:28:55.288338 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG dbcounter [-] [117988] Writing DB stats nova_api:SELECT=66 {{(pid=117988) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:55.293581 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-9413ff15-b60b-4857-90b5-9f15383dd40b tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:55.294031 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-9413ff15-b60b-4857-90b5-9f15383dd40b tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:55.294786 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-9413ff15-b60b-4857-90b5-9f15383dd40b tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:55.295212 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-9413ff15-b60b-4857-90b5-9f15383dd40b tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:55.432161 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-9413ff15-b60b-4857-90b5-9f15383dd40b tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f448776d1074e22bfe6cfbe05e01db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27fe465e6743e19feec424e6e9f3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:55.435535 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG dbcounter [-] [117988] Writing DB stats nova_cell1:SELECT=100 {{(pid=117988) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:55.441262 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-9413ff15-b60b-4857-90b5-9f15383dd40b tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394" status: 200 len: 1521 microversion: 2.1 time: 0.159691 Jul 12 13:28:55.441870 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 112/218] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:28:55 2022] GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:28:56.458122 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-dace75d2-49cd-476a-b344-aedf3795904e tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:28:56.458752 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-dace75d2-49cd-476a-b344-aedf3795904e tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: 95edada5-d3ec-4056-99e9-379fb4b65394] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:28:56.465193 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-dace75d2-49cd-476a-b344-aedf3795904e tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:56.465675 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-dace75d2-49cd-476a-b344-aedf3795904e tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:56.466460 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-dace75d2-49cd-476a-b344-aedf3795904e tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:56.466902 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-dace75d2-49cd-476a-b344-aedf3795904e tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:56.614397 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-dace75d2-49cd-476a-b344-aedf3795904e tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f448776d1074e22bfe6cfbe05e01db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27fe465e6743e19feec424e6e9f3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:56.621866 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-dace75d2-49cd-476a-b344-aedf3795904e tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394" status: 200 len: 1521 microversion: 2.1 time: 0.167861 Jul 12 13:28:56.622431 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 107/219] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:28:56 2022] GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394 => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:28:57.640733 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-712e2b49-08c5-411a-b557-b62917a18b2e tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:28:57.641578 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-712e2b49-08c5-411a-b557-b62917a18b2e tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: 95edada5-d3ec-4056-99e9-379fb4b65394] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:28:57.648498 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-712e2b49-08c5-411a-b557-b62917a18b2e tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:57.648951 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-712e2b49-08c5-411a-b557-b62917a18b2e tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:57.649747 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-712e2b49-08c5-411a-b557-b62917a18b2e tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:57.650183 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-712e2b49-08c5-411a-b557-b62917a18b2e tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:57.794388 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-712e2b49-08c5-411a-b557-b62917a18b2e tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f448776d1074e22bfe6cfbe05e01db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27fe465e6743e19feec424e6e9f3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:57.803004 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-712e2b49-08c5-411a-b557-b62917a18b2e tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394" status: 200 len: 1521 microversion: 2.1 time: 0.167816 Jul 12 13:28:57.803579 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 113/220] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:28:57 2022] GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394 => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:28:58.822238 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-8b43c853-a029-4360-b3ac-bc3b9fed18c8 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:28:58.822964 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-8b43c853-a029-4360-b3ac-bc3b9fed18c8 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: 95edada5-d3ec-4056-99e9-379fb4b65394] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:28:58.831635 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-8b43c853-a029-4360-b3ac-bc3b9fed18c8 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:58.832086 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-8b43c853-a029-4360-b3ac-bc3b9fed18c8 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:58.832870 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-8b43c853-a029-4360-b3ac-bc3b9fed18c8 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:28:58.833311 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-8b43c853-a029-4360-b3ac-bc3b9fed18c8 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:28:58.978254 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-8b43c853-a029-4360-b3ac-bc3b9fed18c8 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f448776d1074e22bfe6cfbe05e01db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27fe465e6743e19feec424e6e9f3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:28:58.990351 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-8b43c853-a029-4360-b3ac-bc3b9fed18c8 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394" status: 200 len: 1521 microversion: 2.1 time: 0.173592 Jul 12 13:28:58.991186 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 108/221] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:28:58 2022] GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394 => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:29:00.007847 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-7eb68740-aa56-42ff-b5be-2231c1ec73f3 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:29:00.008504 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-7eb68740-aa56-42ff-b5be-2231c1ec73f3 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: 95edada5-d3ec-4056-99e9-379fb4b65394] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:29:00.014871 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-7eb68740-aa56-42ff-b5be-2231c1ec73f3 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:29:00.015361 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-7eb68740-aa56-42ff-b5be-2231c1ec73f3 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:29:00.016136 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-7eb68740-aa56-42ff-b5be-2231c1ec73f3 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:29:00.016671 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-7eb68740-aa56-42ff-b5be-2231c1ec73f3 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:29:00.172902 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-7eb68740-aa56-42ff-b5be-2231c1ec73f3 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f448776d1074e22bfe6cfbe05e01db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27fe465e6743e19feec424e6e9f3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:29:00.180379 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-7eb68740-aa56-42ff-b5be-2231c1ec73f3 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394" status: 200 len: 1521 microversion: 2.1 time: 0.176445 Jul 12 13:29:00.180944 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 114/222] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:29:00 2022] GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394 => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:29:01.198721 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-1e16edcc-69c8-4121-86a5-d20f493d22ce tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:29:01.199337 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-1e16edcc-69c8-4121-86a5-d20f493d22ce tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: 95edada5-d3ec-4056-99e9-379fb4b65394] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:29:01.206777 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-1e16edcc-69c8-4121-86a5-d20f493d22ce tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:29:01.207211 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-1e16edcc-69c8-4121-86a5-d20f493d22ce tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:29:01.207996 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-1e16edcc-69c8-4121-86a5-d20f493d22ce tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:29:01.208444 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-1e16edcc-69c8-4121-86a5-d20f493d22ce tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:29:01.247089 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-ee41f877-14b3-4d7e-8910-1c2644743684 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:29:01.247998 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-ee41f877-14b3-4d7e-8910-1c2644743684 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] [instance: fa6eab49-6809-41fa-96c5-a6297dbe51d6] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:29:01.259938 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-ee41f877-14b3-4d7e-8910-1c2644743684 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:29:01.260652 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-ee41f877-14b3-4d7e-8910-1c2644743684 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:29:01.261912 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-ee41f877-14b3-4d7e-8910-1c2644743684 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:29:01.262635 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-ee41f877-14b3-4d7e-8910-1c2644743684 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:29:01.301769 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-ee41f877-14b3-4d7e-8910-1c2644743684 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] [instance: fa6eab49-6809-41fa-96c5-a6297dbe51d6] Going to try to terminate instance {{(pid=117988) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 13:29:01.378216 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-1e16edcc-69c8-4121-86a5-d20f493d22ce tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f448776d1074e22bfe6cfbe05e01db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27fe465e6743e19feec424e6e9f3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:29:01.386568 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-1e16edcc-69c8-4121-86a5-d20f493d22ce tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394" status: 200 len: 1521 microversion: 2.1 time: 0.191857 Jul 12 13:29:01.387116 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 109/223] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:29:01 2022] GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394 => generated 1521 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:29:01.410724 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-ee41f877-14b3-4d7e-8910-1c2644743684 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] 10.222.0.23 "DELETE /compute/v2.1/servers/fa6eab49-6809-41fa-96c5-a6297dbe51d6" status: 204 len: 0 microversion: 2.1 time: 0.174640 Jul 12 13:29:01.411469 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 115/224] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 12 13:29:01 2022] DELETE /compute/v2.1/servers/fa6eab49-6809-41fa-96c5-a6297dbe51d6 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 13:29:01.420815 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-6524a03e-9e45-465d-b375-4debc2a38c5b tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:29:01.421457 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-6524a03e-9e45-465d-b375-4debc2a38c5b tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] [instance: fa6eab49-6809-41fa-96c5-a6297dbe51d6] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:29:01.427673 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-6524a03e-9e45-465d-b375-4debc2a38c5b tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:29:01.428121 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-6524a03e-9e45-465d-b375-4debc2a38c5b tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:29:01.428888 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-6524a03e-9e45-465d-b375-4debc2a38c5b tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:29:01.429320 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-6524a03e-9e45-465d-b375-4debc2a38c5b tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:29:01.587313 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-6524a03e-9e45-465d-b375-4debc2a38c5b tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbc8ad40b44661b526511ecbc51027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd44719e63bb947bdb13e9309d1576521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:29:01.596902 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-6524a03e-9e45-465d-b375-4debc2a38c5b tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] 10.222.0.23 "GET /compute/v2.1/servers/fa6eab49-6809-41fa-96c5-a6297dbe51d6" status: 200 len: 1554 microversion: 2.1 time: 0.180157 Jul 12 13:29:01.597426 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 110/225] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:29:01 2022] GET /compute/v2.1/servers/fa6eab49-6809-41fa-96c5-a6297dbe51d6 => generated 1554 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:29:02.415153 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-b62f6c6c-b97c-4bcc-8fe0-ae19e775ae3c tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:29:02.415953 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-b62f6c6c-b97c-4bcc-8fe0-ae19e775ae3c tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: 95edada5-d3ec-4056-99e9-379fb4b65394] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:29:02.429905 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-b62f6c6c-b97c-4bcc-8fe0-ae19e775ae3c tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:29:02.430359 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-b62f6c6c-b97c-4bcc-8fe0-ae19e775ae3c tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:29:02.431132 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-b62f6c6c-b97c-4bcc-8fe0-ae19e775ae3c tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:29:02.431561 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-b62f6c6c-b97c-4bcc-8fe0-ae19e775ae3c tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:29:02.585876 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-b62f6c6c-b97c-4bcc-8fe0-ae19e775ae3c tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f448776d1074e22bfe6cfbe05e01db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27fe465e6743e19feec424e6e9f3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:29:02.595965 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-b62f6c6c-b97c-4bcc-8fe0-ae19e775ae3c tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394" status: 200 len: 1521 microversion: 2.1 time: 0.189344 Jul 12 13:29:02.596474 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 116/226] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:29:02 2022] GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394 => generated 1521 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:29:02.616817 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-58494014-37dc-40ae-975a-b38277fb733a tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:29:02.617571 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-58494014-37dc-40ae-975a-b38277fb733a tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] [instance: fa6eab49-6809-41fa-96c5-a6297dbe51d6] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:29:02.624381 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-58494014-37dc-40ae-975a-b38277fb733a tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:29:02.624736 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-58494014-37dc-40ae-975a-b38277fb733a tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:29:02.625535 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-58494014-37dc-40ae-975a-b38277fb733a tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:29:02.625962 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-58494014-37dc-40ae-975a-b38277fb733a tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:29:02.774126 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-58494014-37dc-40ae-975a-b38277fb733a tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbc8ad40b44661b526511ecbc51027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd44719e63bb947bdb13e9309d1576521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:29:02.778252 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG dbcounter [-] [117987] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=117987) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:29:02.785837 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-58494014-37dc-40ae-975a-b38277fb733a tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] 10.222.0.23 "GET /compute/v2.1/servers/fa6eab49-6809-41fa-96c5-a6297dbe51d6" status: 200 len: 1554 microversion: 2.1 time: 0.172844 Jul 12 13:29:02.786426 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 111/227] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:29:02 2022] GET /compute/v2.1/servers/fa6eab49-6809-41fa-96c5-a6297dbe51d6 => generated 1554 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:29:03.615164 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-d0174fcc-9f6e-4284-80c5-b4ffb53bfe5b tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:29:03.615864 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-d0174fcc-9f6e-4284-80c5-b4ffb53bfe5b tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: 95edada5-d3ec-4056-99e9-379fb4b65394] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:29:03.622778 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-d0174fcc-9f6e-4284-80c5-b4ffb53bfe5b tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:29:03.623221 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-d0174fcc-9f6e-4284-80c5-b4ffb53bfe5b tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:29:03.623994 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-d0174fcc-9f6e-4284-80c5-b4ffb53bfe5b tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:29:03.624457 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-d0174fcc-9f6e-4284-80c5-b4ffb53bfe5b tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:29:03.809980 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-3e7ac855-b680-421c-bf12-e4fe40a3113b tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:29:03.810845 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-3e7ac855-b680-421c-bf12-e4fe40a3113b tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] [instance: fa6eab49-6809-41fa-96c5-a6297dbe51d6] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:29:03.813615 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-d0174fcc-9f6e-4284-80c5-b4ffb53bfe5b tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f448776d1074e22bfe6cfbe05e01db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27fe465e6743e19feec424e6e9f3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:29:03.821747 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-3e7ac855-b680-421c-bf12-e4fe40a3113b tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:29:03.822187 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-3e7ac855-b680-421c-bf12-e4fe40a3113b tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:29:03.822979 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-3e7ac855-b680-421c-bf12-e4fe40a3113b tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:29:03.823419 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-3e7ac855-b680-421c-bf12-e4fe40a3113b tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:29:03.828536 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-d0174fcc-9f6e-4284-80c5-b4ffb53bfe5b tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394" status: 200 len: 1521 microversion: 2.1 time: 0.218759 Jul 12 13:29:03.829636 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 117/228] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:29:03 2022] GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394 => generated 1521 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:29:04.038582 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-3e7ac855-b680-421c-bf12-e4fe40a3113b tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbc8ad40b44661b526511ecbc51027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd44719e63bb947bdb13e9309d1576521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:29:04.052421 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-3e7ac855-b680-421c-bf12-e4fe40a3113b tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] 10.222.0.23 "GET /compute/v2.1/servers/fa6eab49-6809-41fa-96c5-a6297dbe51d6" status: 200 len: 1554 microversion: 2.1 time: 0.248400 Jul 12 13:29:04.053508 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 112/229] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:29:03 2022] GET /compute/v2.1/servers/fa6eab49-6809-41fa-96c5-a6297dbe51d6 => generated 1554 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:29:04.850261 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-9d76e5af-b522-4cbc-a212-094235f6b20a tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:29:04.851011 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-9d76e5af-b522-4cbc-a212-094235f6b20a tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: 95edada5-d3ec-4056-99e9-379fb4b65394] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:29:04.858797 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-9d76e5af-b522-4cbc-a212-094235f6b20a tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:29:04.859360 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-9d76e5af-b522-4cbc-a212-094235f6b20a tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:29:04.860575 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-9d76e5af-b522-4cbc-a212-094235f6b20a tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:29:04.862672 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-9d76e5af-b522-4cbc-a212-094235f6b20a tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:29:05.077094 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-2f15ceae-63af-4dfb-8be9-5a12252d170d tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:29:05.089604 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-2f15ceae-63af-4dfb-8be9-5a12252d170d tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] [instance: fa6eab49-6809-41fa-96c5-a6297dbe51d6] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:29:05.100083 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-2f15ceae-63af-4dfb-8be9-5a12252d170d tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:29:05.100892 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-2f15ceae-63af-4dfb-8be9-5a12252d170d tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:29:05.102666 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-2f15ceae-63af-4dfb-8be9-5a12252d170d tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:29:05.103228 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-2f15ceae-63af-4dfb-8be9-5a12252d170d tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:29:05.265346 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-2f15ceae-63af-4dfb-8be9-5a12252d170d tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbc8ad40b44661b526511ecbc51027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd44719e63bb947bdb13e9309d1576521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:29:05.280455 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-9d76e5af-b522-4cbc-a212-094235f6b20a tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f448776d1074e22bfe6cfbe05e01db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27fe465e6743e19feec424e6e9f3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:29:05.289559 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-2f15ceae-63af-4dfb-8be9-5a12252d170d tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] 10.222.0.23 "GET /compute/v2.1/servers/fa6eab49-6809-41fa-96c5-a6297dbe51d6" status: 200 len: 1512 microversion: 2.1 time: 0.220340 Jul 12 13:29:05.295565 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 113/230] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:29:05 2022] GET /compute/v2.1/servers/fa6eab49-6809-41fa-96c5-a6297dbe51d6 => generated 1512 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:29:05.301021 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-9d76e5af-b522-4cbc-a212-094235f6b20a tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394" status: 200 len: 1521 microversion: 2.1 time: 0.455631 Jul 12 13:29:05.312105 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [req-187bf836-8180-4e60-b5db-13837a43cfc0 req-1c961f8b-51c4-40ca-abf2-2e33c24e08df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa6eab49-6809-41fa-96c5-a6297dbe51d6", "name": "network-vif-deleted", "tag": "1ae19672-01e9-412a-846d-c5a3eb239196"}]} {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:29:05.314388 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 118/231] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:29:04 2022] GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394 => generated 1521 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:29:05.336849 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [req-187bf836-8180-4e60-b5db-13837a43cfc0 req-1c961f8b-51c4-40ca-abf2-2e33c24e08df service nova] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:29:05.337285 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [req-187bf836-8180-4e60-b5db-13837a43cfc0 req-1c961f8b-51c4-40ca-abf2-2e33c24e08df service nova] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:29:05.358153 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.compute.server_external_events [req-187bf836-8180-4e60-b5db-13837a43cfc0 req-1c961f8b-51c4-40ca-abf2-2e33c24e08df service nova] Creating event network-vif-deleted:1ae19672-01e9-412a-846d-c5a3eb239196 for instance fa6eab49-6809-41fa-96c5-a6297dbe51d6 on hv-cinder-82002 Jul 12 13:29:05.369084 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [req-187bf836-8180-4e60-b5db-13837a43cfc0 req-1c961f8b-51c4-40ca-abf2-2e33c24e08df service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067584 Jul 12 13:29:05.376212 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 114/232] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 12 13:29:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:29:06.321109 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-078389b5-3795-4675-bf48-e235124c3ebe tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:29:06.321890 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-078389b5-3795-4675-bf48-e235124c3ebe tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] [instance: fa6eab49-6809-41fa-96c5-a6297dbe51d6] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:29:06.332126 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-078389b5-3795-4675-bf48-e235124c3ebe tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:29:06.332862 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-078389b5-3795-4675-bf48-e235124c3ebe tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:29:06.333865 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-078389b5-3795-4675-bf48-e235124c3ebe tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:29:06.334489 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-078389b5-3795-4675-bf48-e235124c3ebe tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:29:06.335319 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-f5e6fb23-9cf6-423f-b225-e82ed49d5d69 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:29:06.336634 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-f5e6fb23-9cf6-423f-b225-e82ed49d5d69 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: 95edada5-d3ec-4056-99e9-379fb4b65394] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:29:06.352417 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-f5e6fb23-9cf6-423f-b225-e82ed49d5d69 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:29:06.353199 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-f5e6fb23-9cf6-423f-b225-e82ed49d5d69 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:29:06.354610 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-f5e6fb23-9cf6-423f-b225-e82ed49d5d69 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:29:06.355418 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-f5e6fb23-9cf6-423f-b225-e82ed49d5d69 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:29:06.434083 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-078389b5-3795-4675-bf48-e235124c3ebe tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbc8ad40b44661b526511ecbc51027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd44719e63bb947bdb13e9309d1576521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:29:06.447965 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-078389b5-3795-4675-bf48-e235124c3ebe tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] 10.222.0.23 "GET /compute/v2.1/servers/fa6eab49-6809-41fa-96c5-a6297dbe51d6" status: 200 len: 1346 microversion: 2.1 time: 0.131192 Jul 12 13:29:06.448566 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 119/233] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:29:06 2022] GET /compute/v2.1/servers/fa6eab49-6809-41fa-96c5-a6297dbe51d6 => generated 1346 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:29:06.544930 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-f5e6fb23-9cf6-423f-b225-e82ed49d5d69 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f448776d1074e22bfe6cfbe05e01db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27fe465e6743e19feec424e6e9f3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:29:06.559950 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-f5e6fb23-9cf6-423f-b225-e82ed49d5d69 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394" status: 200 len: 1521 microversion: 2.1 time: 0.234221 Jul 12 13:29:06.560838 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 115/234] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:29:06 2022] GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394 => generated 1521 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:29:07.468560 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-6250f004-3af4-44a6-adfc-3828aaaded99 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:29:07.469236 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-6250f004-3af4-44a6-adfc-3828aaaded99 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] [instance: fa6eab49-6809-41fa-96c5-a6297dbe51d6] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:29:07.477064 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-6250f004-3af4-44a6-adfc-3828aaaded99 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:29:07.477539 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-6250f004-3af4-44a6-adfc-3828aaaded99 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:29:07.493525 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-6250f004-3af4-44a6-adfc-3828aaaded99 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:29:07.494190 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-6250f004-3af4-44a6-adfc-3828aaaded99 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:29:07.572303 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-6250f004-3af4-44a6-adfc-3828aaaded99 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbc8ad40b44661b526511ecbc51027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd44719e63bb947bdb13e9309d1576521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:29:07.583568 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-6250f004-3af4-44a6-adfc-3828aaaded99 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] 10.222.0.23 "GET /compute/v2.1/servers/fa6eab49-6809-41fa-96c5-a6297dbe51d6" status: 200 len: 1346 microversion: 2.1 time: 0.120791 Jul 12 13:29:07.584400 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 120/235] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:29:07 2022] GET /compute/v2.1/servers/fa6eab49-6809-41fa-96c5-a6297dbe51d6 => generated 1346 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:29:07.586093 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-c2786ddd-4e72-412b-9b6f-17b121ceafd4 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:29:07.586716 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-c2786ddd-4e72-412b-9b6f-17b121ceafd4 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: 95edada5-d3ec-4056-99e9-379fb4b65394] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:29:07.595806 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-c2786ddd-4e72-412b-9b6f-17b121ceafd4 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:29:07.596249 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-c2786ddd-4e72-412b-9b6f-17b121ceafd4 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:29:07.597022 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-c2786ddd-4e72-412b-9b6f-17b121ceafd4 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:29:07.597486 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-c2786ddd-4e72-412b-9b6f-17b121ceafd4 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:29:07.746403 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-c2786ddd-4e72-412b-9b6f-17b121ceafd4 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f448776d1074e22bfe6cfbe05e01db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27fe465e6743e19feec424e6e9f3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:29:07.754466 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-c2786ddd-4e72-412b-9b6f-17b121ceafd4 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394" status: 200 len: 1521 microversion: 2.1 time: 0.172233 Jul 12 13:29:07.755045 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 116/236] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:29:07 2022] GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394 => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:29:08.601976 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-9b3f3226-5a3d-4d95-8533-a0cd5c92e8b4 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:29:08.602621 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-9b3f3226-5a3d-4d95-8533-a0cd5c92e8b4 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] [instance: fa6eab49-6809-41fa-96c5-a6297dbe51d6] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:29:08.608565 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-9b3f3226-5a3d-4d95-8533-a0cd5c92e8b4 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:29:08.609011 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-9b3f3226-5a3d-4d95-8533-a0cd5c92e8b4 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:29:08.609801 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-9b3f3226-5a3d-4d95-8533-a0cd5c92e8b4 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:29:08.610234 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-9b3f3226-5a3d-4d95-8533-a0cd5c92e8b4 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:29:08.677848 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-9b3f3226-5a3d-4d95-8533-a0cd5c92e8b4 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbc8ad40b44661b526511ecbc51027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd44719e63bb947bdb13e9309d1576521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:29:08.685896 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-9b3f3226-5a3d-4d95-8533-a0cd5c92e8b4 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] 10.222.0.23 "GET /compute/v2.1/servers/fa6eab49-6809-41fa-96c5-a6297dbe51d6" status: 200 len: 1346 microversion: 2.1 time: 0.087609 Jul 12 13:29:08.686463 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 121/237] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:29:08 2022] GET /compute/v2.1/servers/fa6eab49-6809-41fa-96c5-a6297dbe51d6 => generated 1346 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:29:08.771330 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-314b79fd-83e0-400a-b628-9d8bbfa7d9ab tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:29:08.771864 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-314b79fd-83e0-400a-b628-9d8bbfa7d9ab tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: 95edada5-d3ec-4056-99e9-379fb4b65394] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:29:08.778528 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-314b79fd-83e0-400a-b628-9d8bbfa7d9ab tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:29:08.778970 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-314b79fd-83e0-400a-b628-9d8bbfa7d9ab tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:29:08.779735 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-314b79fd-83e0-400a-b628-9d8bbfa7d9ab tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:29:08.780160 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-314b79fd-83e0-400a-b628-9d8bbfa7d9ab tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:29:08.916505 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-314b79fd-83e0-400a-b628-9d8bbfa7d9ab tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f448776d1074e22bfe6cfbe05e01db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27fe465e6743e19feec424e6e9f3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:29:08.925017 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-314b79fd-83e0-400a-b628-9d8bbfa7d9ab tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394" status: 200 len: 1521 microversion: 2.1 time: 0.157640 Jul 12 13:29:08.925799 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 117/238] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:29:08 2022] GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:29:09.702976 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-0ac78be1-6785-4bdb-a651-01f4b51f0f5b tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:29:09.703592 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-0ac78be1-6785-4bdb-a651-01f4b51f0f5b tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] [instance: fa6eab49-6809-41fa-96c5-a6297dbe51d6] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:29:09.710092 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-0ac78be1-6785-4bdb-a651-01f4b51f0f5b tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:29:09.710541 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-0ac78be1-6785-4bdb-a651-01f4b51f0f5b tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:29:09.711302 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-0ac78be1-6785-4bdb-a651-01f4b51f0f5b tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:29:09.711829 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-0ac78be1-6785-4bdb-a651-01f4b51f0f5b tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:29:09.773327 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-0ac78be1-6785-4bdb-a651-01f4b51f0f5b tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbc8ad40b44661b526511ecbc51027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd44719e63bb947bdb13e9309d1576521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:29:09.781514 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-0ac78be1-6785-4bdb-a651-01f4b51f0f5b tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] 10.222.0.23 "GET /compute/v2.1/servers/fa6eab49-6809-41fa-96c5-a6297dbe51d6" status: 200 len: 1346 microversion: 2.1 time: 0.082210 Jul 12 13:29:09.782088 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 122/239] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:29:09 2022] GET /compute/v2.1/servers/fa6eab49-6809-41fa-96c5-a6297dbe51d6 => generated 1346 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:29:09.942611 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-cbae5768-32ea-4ce6-ae70-cf09c611edd5 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:29:09.943336 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-cbae5768-32ea-4ce6-ae70-cf09c611edd5 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: 95edada5-d3ec-4056-99e9-379fb4b65394] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:29:09.950650 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-cbae5768-32ea-4ce6-ae70-cf09c611edd5 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:29:09.951142 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-cbae5768-32ea-4ce6-ae70-cf09c611edd5 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:29:09.952181 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-cbae5768-32ea-4ce6-ae70-cf09c611edd5 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:29:09.952609 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-cbae5768-32ea-4ce6-ae70-cf09c611edd5 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:29:10.090717 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-cbae5768-32ea-4ce6-ae70-cf09c611edd5 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f448776d1074e22bfe6cfbe05e01db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27fe465e6743e19feec424e6e9f3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:29:10.098468 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-cbae5768-32ea-4ce6-ae70-cf09c611edd5 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394" status: 200 len: 1521 microversion: 2.1 time: 0.160473 Jul 12 13:29:10.099039 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 118/240] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:29:09 2022] GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:29:10.800246 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-bf0b4d5d-65e0-4cac-8d49-a52cb1314007 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:29:10.801006 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-bf0b4d5d-65e0-4cac-8d49-a52cb1314007 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] [instance: fa6eab49-6809-41fa-96c5-a6297dbe51d6] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:29:10.808887 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-bf0b4d5d-65e0-4cac-8d49-a52cb1314007 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:29:10.809330 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-bf0b4d5d-65e0-4cac-8d49-a52cb1314007 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:29:10.810223 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-bf0b4d5d-65e0-4cac-8d49-a52cb1314007 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:29:10.810692 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-bf0b4d5d-65e0-4cac-8d49-a52cb1314007 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:29:10.845961 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-bf0b4d5d-65e0-4cac-8d49-a52cb1314007 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:29:10.846322 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-bf0b4d5d-65e0-4cac-8d49-a52cb1314007 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:29:10.846802 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.objects.instance [None req-bf0b4d5d-65e0-4cac-8d49-a52cb1314007 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lazy-loading 'fault' on Instance uuid fa6eab49-6809-41fa-96c5-a6297dbe51d6 {{(pid=117988) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 13:29:10.894426 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-bf0b4d5d-65e0-4cac-8d49-a52cb1314007 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbc8ad40b44661b526511ecbc51027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd44719e63bb947bdb13e9309d1576521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:29:10.920851 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-bf0b4d5d-65e0-4cac-8d49-a52cb1314007 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] 10.222.0.23 "GET /compute/v2.1/servers/fa6eab49-6809-41fa-96c5-a6297dbe51d6" status: 200 len: 1351 microversion: 2.1 time: 0.125363 Jul 12 13:29:10.921402 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 123/241] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:29:10 2022] GET /compute/v2.1/servers/fa6eab49-6809-41fa-96c5-a6297dbe51d6 => generated 1351 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:29:11.116175 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-a9a86467-10f2-4e31-b852-0cab0c52fa28 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:29:11.116796 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-a9a86467-10f2-4e31-b852-0cab0c52fa28 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: 95edada5-d3ec-4056-99e9-379fb4b65394] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:29:11.123420 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-a9a86467-10f2-4e31-b852-0cab0c52fa28 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:29:11.123869 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-a9a86467-10f2-4e31-b852-0cab0c52fa28 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:29:11.124634 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-a9a86467-10f2-4e31-b852-0cab0c52fa28 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:29:11.125069 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-a9a86467-10f2-4e31-b852-0cab0c52fa28 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:29:11.290597 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-a9a86467-10f2-4e31-b852-0cab0c52fa28 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f448776d1074e22bfe6cfbe05e01db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27fe465e6743e19feec424e6e9f3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:29:11.298709 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-a9a86467-10f2-4e31-b852-0cab0c52fa28 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394" status: 200 len: 1521 microversion: 2.1 time: 0.186451 Jul 12 13:29:11.299637 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 119/242] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:29:11 2022] GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394 => generated 1521 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:29:11.938538 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-e6af131c-8339-4a9d-b42b-a2fbfd32b88a tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:29:11.939880 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-e6af131c-8339-4a9d-b42b-a2fbfd32b88a tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] [instance: fa6eab49-6809-41fa-96c5-a6297dbe51d6] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:29:11.946185 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-e6af131c-8339-4a9d-b42b-a2fbfd32b88a tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:29:11.946684 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-e6af131c-8339-4a9d-b42b-a2fbfd32b88a tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:29:11.947467 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-e6af131c-8339-4a9d-b42b-a2fbfd32b88a tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:29:11.947902 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-e6af131c-8339-4a9d-b42b-a2fbfd32b88a tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:29:11.961981 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.wsgi [None req-e6af131c-8339-4a9d-b42b-a2fbfd32b88a tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] HTTP exception thrown: Instance fa6eab49-6809-41fa-96c5-a6297dbe51d6 could not be found. Jul 12 13:29:11.967258 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-e6af131c-8339-4a9d-b42b-a2fbfd32b88a tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Request method failure captured: Jul 12 13:29:11.967258 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: request: GET /compute/v2.1/servers/fa6eab49-6809-41fa-96c5-a6297dbe51d6 HTTP/1.1 Jul 12 13:29:11.967258 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: Accept: application/json Jul 12 13:29:11.967258 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: Accept-Encoding: identity Jul 12 13:29:11.967258 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: Connection: close Jul 12 13:29:11.967258 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: Content-Length: 0 Jul 12 13:29:11.967258 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: Content-Type: application/json Jul 12 13:29:11.967258 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: Host: 10.222.0.23 Jul 12 13:29:11.967258 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: Openstack-System-Scope: None Jul 12 13:29:11.967258 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: User-Agent: python-urllib3/1.26.9 Jul 12 13:29:11.967258 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Auth-Token: gAAAAABizXbIhb0HMwOJzejzgdqReNA8lmDwoIHrMHzHNP6Asosb9t8rNqLuutHz0bNa6YGok5AdeQaG0HKreG103s1RFjxXIo86tPqB_3mEbm389XfRFsTgQ7xJGYJEV2VGzjTUncOPA8E7gxD40dGg3cCeqv-7B7_MLYSqkbqiI_gN1N7laNY Jul 12 13:29:11.967258 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Domain-Id: None Jul 12 13:29:11.967258 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Domain-Name: None Jul 12 13:29:11.967258 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Identity-Status: Confirmed Jul 12 13:29:11.967258 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Is-Admin-Project: True Jul 12 13:29:11.967258 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Project-Domain-Id: default Jul 12 13:29:11.967258 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Project-Domain-Name: Default Jul 12 13:29:11.967258 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Project-Id: d44719e63bb947bdb13e9309d1576521 Jul 12 13:29:11.967258 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Project-Name: tempest-DeleteServersTestJSON-1602255744 Jul 12 13:29:11.967258 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Role: reader,member Jul 12 13:29:11.967258 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Roles: reader,member Jul 12 13:29:11.968818 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d44719e63bb947bdb13e9309d1576521"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d44719e63bb947bdb13e9309d1576521", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d44719e63bb947bdb13e9309d1576521"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d44719e63bb947bdb13e9309d1576521"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] Jul 12 13:29:11.968818 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Tenant: tempest-DeleteServersTestJSON-1602255744 Jul 12 13:29:11.968818 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Tenant-Id: d44719e63bb947bdb13e9309d1576521 Jul 12 13:29:11.968818 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Tenant-Name: tempest-DeleteServersTestJSON-1602255744 Jul 12 13:29:11.968818 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-User: tempest-DeleteServersTestJSON-1602255744-project Jul 12 13:29:11.968818 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-User-Domain-Id: default Jul 12 13:29:11.968818 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-User-Domain-Name: Default Jul 12 13:29:11.968818 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-User-Id: 83bbc8ad40b44661b526511ecbc51027 Jul 12 13:29:11.968818 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-User-Name: tempest-DeleteServersTestJSON-1602255744-project Jul 12 13:29:11.968818 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: method: > Jul 12 13:29:11.968818 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: exception: Instance fa6eab49-6809-41fa-96c5-a6297dbe51d6 could not be found. Jul 12 13:29:11.968818 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: action_args: {'id': 'fa6eab49-6809-41fa-96c5-a6297dbe51d6'} Jul 12 13:29:11.969838 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 13:29:11.969838 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:29:11.969838 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 13:29:11.969838 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 13:29:11.969838 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 13:29:11.969838 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 13:29:11.969838 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 13:29:11.969838 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 13:29:11.969838 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 13:29:11.969838 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 13:29:11.969838 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa6eab49-6809-41fa-96c5-a6297dbe51d6 could not be found. Jul 12 13:29:11.969838 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi Jul 12 13:29:11.969838 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:29:11.969838 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi Jul 12 13:29:11.969838 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:29:11.969838 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:29:11.969838 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:29:11.969838 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 13:29:11.969838 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 13:29:11.969838 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 13:29:11.971187 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:29:11.971187 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 13:29:11.971187 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 13:29:11.971187 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 13:29:11.971187 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 13:29:11.971187 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 13:29:11.971187 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 13:29:11.971187 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa6eab49-6809-41fa-96c5-a6297dbe51d6 could not be found. Jul 12 13:29:11.971187 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi Jul 12 13:29:11.971187 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:29:11.971187 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi Jul 12 13:29:11.971187 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:29:11.971187 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:29:11.971187 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:29:11.971187 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 13:29:11.971187 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 13:29:11.971187 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa6eab49-6809-41fa-96c5-a6297dbe51d6 could not be found. Jul 12 13:29:11.971187 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi Jul 12 13:29:11.973421 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-e6af131c-8339-4a9d-b42b-a2fbfd32b88a tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Returning 404 to user: Instance fa6eab49-6809-41fa-96c5-a6297dbe51d6 could not be found. {{(pid=117988) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 13:29:11.973421 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-e6af131c-8339-4a9d-b42b-a2fbfd32b88a tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] 10.222.0.23 "GET /compute/v2.1/servers/fa6eab49-6809-41fa-96c5-a6297dbe51d6" status: 404 len: 111 microversion: 2.1 time: 0.034147 Jul 12 13:29:11.973421 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 124/243] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:29:11 2022] GET /compute/v2.1/servers/fa6eab49-6809-41fa-96c5-a6297dbe51d6 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 13:29:12.081395 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-0484ec36-d286-496c-b240-1efc397bc473 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:29:12.082312 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-0484ec36-d286-496c-b240-1efc397bc473 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] [instance: fa6eab49-6809-41fa-96c5-a6297dbe51d6] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:29:12.088279 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-0484ec36-d286-496c-b240-1efc397bc473 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:29:12.088729 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-0484ec36-d286-496c-b240-1efc397bc473 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:29:12.089523 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-0484ec36-d286-496c-b240-1efc397bc473 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:29:12.089962 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-0484ec36-d286-496c-b240-1efc397bc473 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:29:12.103904 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.wsgi [None req-0484ec36-d286-496c-b240-1efc397bc473 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] HTTP exception thrown: Instance fa6eab49-6809-41fa-96c5-a6297dbe51d6 could not be found. Jul 12 13:29:12.107948 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-0484ec36-d286-496c-b240-1efc397bc473 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Request method failure captured: Jul 12 13:29:12.107948 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: request: GET /compute/v2.1/servers/fa6eab49-6809-41fa-96c5-a6297dbe51d6/os-volume_attachments HTTP/1.1 Jul 12 13:29:12.107948 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: Accept: application/json Jul 12 13:29:12.107948 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: Accept-Encoding: identity Jul 12 13:29:12.107948 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: Connection: close Jul 12 13:29:12.107948 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: Content-Length: 0 Jul 12 13:29:12.107948 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: Content-Type: application/json Jul 12 13:29:12.107948 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: Host: 10.222.0.23 Jul 12 13:29:12.107948 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: Openstack-System-Scope: None Jul 12 13:29:12.107948 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: User-Agent: python-urllib3/1.26.9 Jul 12 13:29:12.107948 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Auth-Token: gAAAAABizXbIhb0HMwOJzejzgdqReNA8lmDwoIHrMHzHNP6Asosb9t8rNqLuutHz0bNa6YGok5AdeQaG0HKreG103s1RFjxXIo86tPqB_3mEbm389XfRFsTgQ7xJGYJEV2VGzjTUncOPA8E7gxD40dGg3cCeqv-7B7_MLYSqkbqiI_gN1N7laNY Jul 12 13:29:12.107948 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Domain-Id: None Jul 12 13:29:12.107948 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Domain-Name: None Jul 12 13:29:12.107948 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Identity-Status: Confirmed Jul 12 13:29:12.107948 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Is-Admin-Project: True Jul 12 13:29:12.107948 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Project-Domain-Id: default Jul 12 13:29:12.107948 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Project-Domain-Name: Default Jul 12 13:29:12.107948 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Project-Id: d44719e63bb947bdb13e9309d1576521 Jul 12 13:29:12.107948 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Project-Name: tempest-DeleteServersTestJSON-1602255744 Jul 12 13:29:12.107948 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Role: reader,member Jul 12 13:29:12.107948 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Roles: reader,member Jul 12 13:29:12.109152 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d44719e63bb947bdb13e9309d1576521"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d44719e63bb947bdb13e9309d1576521", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d44719e63bb947bdb13e9309d1576521"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d44719e63bb947bdb13e9309d1576521"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] Jul 12 13:29:12.109152 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Tenant: tempest-DeleteServersTestJSON-1602255744 Jul 12 13:29:12.109152 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Tenant-Id: d44719e63bb947bdb13e9309d1576521 Jul 12 13:29:12.109152 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Tenant-Name: tempest-DeleteServersTestJSON-1602255744 Jul 12 13:29:12.109152 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-User: tempest-DeleteServersTestJSON-1602255744-project Jul 12 13:29:12.109152 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-User-Domain-Id: default Jul 12 13:29:12.109152 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-User-Domain-Name: Default Jul 12 13:29:12.109152 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-User-Id: 83bbc8ad40b44661b526511ecbc51027 Jul 12 13:29:12.109152 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-User-Name: tempest-DeleteServersTestJSON-1602255744-project Jul 12 13:29:12.109152 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: method: > Jul 12 13:29:12.109152 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: exception: Instance fa6eab49-6809-41fa-96c5-a6297dbe51d6 could not be found. Jul 12 13:29:12.109152 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: action_args: {'server_id': 'fa6eab49-6809-41fa-96c5-a6297dbe51d6'} Jul 12 13:29:12.109879 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 13:29:12.109879 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:29:12.109879 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 13:29:12.109879 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 13:29:12.109879 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 13:29:12.109879 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 13:29:12.109879 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 13:29:12.109879 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 13:29:12.109879 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 13:29:12.109879 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 13:29:12.109879 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa6eab49-6809-41fa-96c5-a6297dbe51d6 could not be found. Jul 12 13:29:12.109879 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi Jul 12 13:29:12.109879 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:29:12.109879 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi Jul 12 13:29:12.109879 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:29:12.109879 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:29:12.109879 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:29:12.109879 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 13:29:12.109879 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 13:29:12.109879 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 13:29:12.110959 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:29:12.110959 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 12 13:29:12.110959 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 13:29:12.110959 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 12 13:29:12.110959 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 13:29:12.110959 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 12 13:29:12.110959 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 12 13:29:12.110959 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 13:29:12.110959 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 13:29:12.110959 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa6eab49-6809-41fa-96c5-a6297dbe51d6 could not be found. Jul 12 13:29:12.110959 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi Jul 12 13:29:12.110959 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:29:12.110959 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi Jul 12 13:29:12.110959 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:29:12.110959 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:29:12.110959 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:29:12.110959 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 13:29:12.110959 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 13:29:12.110959 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa6eab49-6809-41fa-96c5-a6297dbe51d6 could not be found. Jul 12 13:29:12.110959 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi Jul 12 13:29:12.112219 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-0484ec36-d286-496c-b240-1efc397bc473 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Returning 404 to user: Instance fa6eab49-6809-41fa-96c5-a6297dbe51d6 could not be found. {{(pid=117987) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 13:29:12.112219 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-0484ec36-d286-496c-b240-1efc397bc473 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] 10.222.0.23 "GET /compute/v2.1/servers/fa6eab49-6809-41fa-96c5-a6297dbe51d6/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.032048 Jul 12 13:29:12.112219 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 120/244] 10.222.0.23 () {58 vars in 1301 bytes} [Tue Jul 12 13:29:12 2022] GET /compute/v2.1/servers/fa6eab49-6809-41fa-96c5-a6297dbe51d6/os-volume_attachments => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 13:29:12.316828 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-6620c3e1-af8e-45f6-8f7b-a21e822038d8 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:29:12.317476 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-6620c3e1-af8e-45f6-8f7b-a21e822038d8 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: 95edada5-d3ec-4056-99e9-379fb4b65394] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:29:12.323408 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-6620c3e1-af8e-45f6-8f7b-a21e822038d8 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:29:12.323848 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-6620c3e1-af8e-45f6-8f7b-a21e822038d8 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:29:12.324632 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-6620c3e1-af8e-45f6-8f7b-a21e822038d8 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:29:12.325059 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-6620c3e1-af8e-45f6-8f7b-a21e822038d8 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:29:12.452366 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-6620c3e1-af8e-45f6-8f7b-a21e822038d8 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f448776d1074e22bfe6cfbe05e01db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27fe465e6743e19feec424e6e9f3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:29:12.460550 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-6620c3e1-af8e-45f6-8f7b-a21e822038d8 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394" status: 200 len: 1521 microversion: 2.1 time: 0.148039 Jul 12 13:29:12.461195 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 125/245] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:29:12 2022] GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394 => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:29:13.322165 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-7a96d689-e018-42ff-b874-7cdc35984295 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:29:13.322673 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-7a96d689-e018-42ff-b874-7cdc35984295 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] [instance: fa6eab49-6809-41fa-96c5-a6297dbe51d6] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:29:13.330077 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-7a96d689-e018-42ff-b874-7cdc35984295 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:29:13.330529 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-7a96d689-e018-42ff-b874-7cdc35984295 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:29:13.332060 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-7a96d689-e018-42ff-b874-7cdc35984295 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:29:13.332272 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-7a96d689-e018-42ff-b874-7cdc35984295 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:29:13.346386 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.wsgi [None req-7a96d689-e018-42ff-b874-7cdc35984295 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] HTTP exception thrown: Instance fa6eab49-6809-41fa-96c5-a6297dbe51d6 could not be found. Jul 12 13:29:13.349158 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-7a96d689-e018-42ff-b874-7cdc35984295 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Request method failure captured: Jul 12 13:29:13.349158 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: request: DELETE /compute/v2.1/servers/fa6eab49-6809-41fa-96c5-a6297dbe51d6 HTTP/1.1 Jul 12 13:29:13.349158 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: Accept: application/json Jul 12 13:29:13.349158 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: Accept-Encoding: identity Jul 12 13:29:13.349158 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: Connection: close Jul 12 13:29:13.349158 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: Content-Length: 0 Jul 12 13:29:13.349158 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: Content-Type: application/json Jul 12 13:29:13.349158 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: Host: 10.222.0.23 Jul 12 13:29:13.349158 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: Openstack-System-Scope: None Jul 12 13:29:13.349158 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: User-Agent: python-urllib3/1.26.9 Jul 12 13:29:13.349158 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Auth-Token: gAAAAABizXbIhb0HMwOJzejzgdqReNA8lmDwoIHrMHzHNP6Asosb9t8rNqLuutHz0bNa6YGok5AdeQaG0HKreG103s1RFjxXIo86tPqB_3mEbm389XfRFsTgQ7xJGYJEV2VGzjTUncOPA8E7gxD40dGg3cCeqv-7B7_MLYSqkbqiI_gN1N7laNY Jul 12 13:29:13.349158 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Domain-Id: None Jul 12 13:29:13.349158 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Domain-Name: None Jul 12 13:29:13.349158 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Identity-Status: Confirmed Jul 12 13:29:13.349158 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Is-Admin-Project: True Jul 12 13:29:13.349158 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Project-Domain-Id: default Jul 12 13:29:13.349158 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Project-Domain-Name: Default Jul 12 13:29:13.349158 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Project-Id: d44719e63bb947bdb13e9309d1576521 Jul 12 13:29:13.349158 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Project-Name: tempest-DeleteServersTestJSON-1602255744 Jul 12 13:29:13.349158 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Role: reader,member Jul 12 13:29:13.349158 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Roles: reader,member Jul 12 13:29:13.350619 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d44719e63bb947bdb13e9309d1576521"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d44719e63bb947bdb13e9309d1576521", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d44719e63bb947bdb13e9309d1576521"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d44719e63bb947bdb13e9309d1576521"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] Jul 12 13:29:13.350619 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Tenant: tempest-DeleteServersTestJSON-1602255744 Jul 12 13:29:13.350619 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Tenant-Id: d44719e63bb947bdb13e9309d1576521 Jul 12 13:29:13.350619 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Tenant-Name: tempest-DeleteServersTestJSON-1602255744 Jul 12 13:29:13.350619 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-User: tempest-DeleteServersTestJSON-1602255744-project Jul 12 13:29:13.350619 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-User-Domain-Id: default Jul 12 13:29:13.350619 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-User-Domain-Name: Default Jul 12 13:29:13.350619 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-User-Id: 83bbc8ad40b44661b526511ecbc51027 Jul 12 13:29:13.350619 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-User-Name: tempest-DeleteServersTestJSON-1602255744-project Jul 12 13:29:13.350619 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: method: > Jul 12 13:29:13.350619 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: exception: Instance fa6eab49-6809-41fa-96c5-a6297dbe51d6 could not be found. Jul 12 13:29:13.350619 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: action_args: {'id': 'fa6eab49-6809-41fa-96c5-a6297dbe51d6'} Jul 12 13:29:13.351565 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 13:29:13.351565 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:29:13.351565 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 13:29:13.351565 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 13:29:13.351565 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 13:29:13.351565 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 13:29:13.351565 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 13:29:13.351565 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 13:29:13.351565 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 13:29:13.351565 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 13:29:13.351565 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa6eab49-6809-41fa-96c5-a6297dbe51d6 could not be found. Jul 12 13:29:13.351565 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi Jul 12 13:29:13.351565 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:29:13.351565 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi Jul 12 13:29:13.351565 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:29:13.351565 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:29:13.351565 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:29:13.351565 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 13:29:13.351565 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 13:29:13.351565 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 13:29:13.354164 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:29:13.354164 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 12 13:29:13.354164 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 12 13:29:13.354164 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 12 13:29:13.354164 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 12 13:29:13.354164 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 13:29:13.354164 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 13:29:13.354164 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 13:29:13.354164 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 13:29:13.354164 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa6eab49-6809-41fa-96c5-a6297dbe51d6 could not be found. Jul 12 13:29:13.354164 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi Jul 12 13:29:13.354164 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:29:13.354164 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi Jul 12 13:29:13.354164 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:29:13.354164 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:29:13.354164 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:29:13.354164 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 13:29:13.354164 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 13:29:13.354164 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa6eab49-6809-41fa-96c5-a6297dbe51d6 could not be found. Jul 12 13:29:13.354164 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi Jul 12 13:29:13.356687 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-7a96d689-e018-42ff-b874-7cdc35984295 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Returning 404 to user: Instance fa6eab49-6809-41fa-96c5-a6297dbe51d6 could not be found. {{(pid=117987) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 13:29:13.356687 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-7a96d689-e018-42ff-b874-7cdc35984295 tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] 10.222.0.23 "DELETE /compute/v2.1/servers/fa6eab49-6809-41fa-96c5-a6297dbe51d6" status: 404 len: 111 microversion: 2.1 time: 0.032263 Jul 12 13:29:13.356687 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 121/246] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 12 13:29:13 2022] DELETE /compute/v2.1/servers/fa6eab49-6809-41fa-96c5-a6297dbe51d6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 13:29:13.358972 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-79a8c169-da97-4949-9d2c-e5bb9bb0452a tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:29:13.359579 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-79a8c169-da97-4949-9d2c-e5bb9bb0452a tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] [instance: fa6eab49-6809-41fa-96c5-a6297dbe51d6] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:29:13.365506 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-79a8c169-da97-4949-9d2c-e5bb9bb0452a tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:29:13.365957 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-79a8c169-da97-4949-9d2c-e5bb9bb0452a tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:29:13.366707 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-79a8c169-da97-4949-9d2c-e5bb9bb0452a tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:29:13.367139 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-79a8c169-da97-4949-9d2c-e5bb9bb0452a tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:29:13.380815 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.wsgi [None req-79a8c169-da97-4949-9d2c-e5bb9bb0452a tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] HTTP exception thrown: Instance fa6eab49-6809-41fa-96c5-a6297dbe51d6 could not be found. Jul 12 13:29:13.382409 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-79a8c169-da97-4949-9d2c-e5bb9bb0452a tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Request method failure captured: Jul 12 13:29:13.382409 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: request: GET /compute/v2.1/servers/fa6eab49-6809-41fa-96c5-a6297dbe51d6 HTTP/1.1 Jul 12 13:29:13.382409 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: Accept: application/json Jul 12 13:29:13.382409 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: Accept-Encoding: identity Jul 12 13:29:13.382409 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: Connection: close Jul 12 13:29:13.382409 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: Content-Length: 0 Jul 12 13:29:13.382409 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: Content-Type: application/json Jul 12 13:29:13.382409 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: Host: 10.222.0.23 Jul 12 13:29:13.382409 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: Openstack-System-Scope: None Jul 12 13:29:13.382409 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: User-Agent: python-urllib3/1.26.9 Jul 12 13:29:13.382409 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Auth-Token: gAAAAABizXbIhb0HMwOJzejzgdqReNA8lmDwoIHrMHzHNP6Asosb9t8rNqLuutHz0bNa6YGok5AdeQaG0HKreG103s1RFjxXIo86tPqB_3mEbm389XfRFsTgQ7xJGYJEV2VGzjTUncOPA8E7gxD40dGg3cCeqv-7B7_MLYSqkbqiI_gN1N7laNY Jul 12 13:29:13.382409 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Domain-Id: None Jul 12 13:29:13.382409 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Domain-Name: None Jul 12 13:29:13.382409 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Identity-Status: Confirmed Jul 12 13:29:13.382409 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Is-Admin-Project: True Jul 12 13:29:13.382409 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Project-Domain-Id: default Jul 12 13:29:13.382409 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Project-Domain-Name: Default Jul 12 13:29:13.382409 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Project-Id: d44719e63bb947bdb13e9309d1576521 Jul 12 13:29:13.382409 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Project-Name: tempest-DeleteServersTestJSON-1602255744 Jul 12 13:29:13.382409 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Role: reader,member Jul 12 13:29:13.382409 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Roles: reader,member Jul 12 13:29:13.384295 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d44719e63bb947bdb13e9309d1576521"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d44719e63bb947bdb13e9309d1576521", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d44719e63bb947bdb13e9309d1576521"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d44719e63bb947bdb13e9309d1576521"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] Jul 12 13:29:13.384295 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Tenant: tempest-DeleteServersTestJSON-1602255744 Jul 12 13:29:13.384295 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Tenant-Id: d44719e63bb947bdb13e9309d1576521 Jul 12 13:29:13.384295 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Tenant-Name: tempest-DeleteServersTestJSON-1602255744 Jul 12 13:29:13.384295 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-User: tempest-DeleteServersTestJSON-1602255744-project Jul 12 13:29:13.384295 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-User-Domain-Id: default Jul 12 13:29:13.384295 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-User-Domain-Name: Default Jul 12 13:29:13.384295 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-User-Id: 83bbc8ad40b44661b526511ecbc51027 Jul 12 13:29:13.384295 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-User-Name: tempest-DeleteServersTestJSON-1602255744-project Jul 12 13:29:13.384295 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: method: > Jul 12 13:29:13.384295 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: exception: Instance fa6eab49-6809-41fa-96c5-a6297dbe51d6 could not be found. Jul 12 13:29:13.384295 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: action_args: {'id': 'fa6eab49-6809-41fa-96c5-a6297dbe51d6'} Jul 12 13:29:13.385181 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 13:29:13.385181 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:29:13.385181 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 13:29:13.385181 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 13:29:13.385181 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 13:29:13.385181 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 13:29:13.385181 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 13:29:13.385181 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 13:29:13.385181 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 13:29:13.385181 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 13:29:13.385181 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa6eab49-6809-41fa-96c5-a6297dbe51d6 could not be found. Jul 12 13:29:13.385181 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi Jul 12 13:29:13.385181 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:29:13.385181 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi Jul 12 13:29:13.385181 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:29:13.385181 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:29:13.385181 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:29:13.385181 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 13:29:13.385181 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 13:29:13.385181 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 13:29:13.386444 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:29:13.386444 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 13:29:13.386444 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 13:29:13.386444 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 13:29:13.386444 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 13:29:13.386444 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 13:29:13.386444 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 13:29:13.386444 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa6eab49-6809-41fa-96c5-a6297dbe51d6 could not be found. Jul 12 13:29:13.386444 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi Jul 12 13:29:13.386444 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:29:13.386444 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi Jul 12 13:29:13.386444 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:29:13.386444 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:29:13.386444 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:29:13.386444 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 13:29:13.386444 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 13:29:13.386444 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa6eab49-6809-41fa-96c5-a6297dbe51d6 could not be found. Jul 12 13:29:13.386444 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi Jul 12 13:29:13.387648 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-79a8c169-da97-4949-9d2c-e5bb9bb0452a tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] Returning 404 to user: Instance fa6eab49-6809-41fa-96c5-a6297dbe51d6 could not be found. {{(pid=117988) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 13:29:13.387648 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-79a8c169-da97-4949-9d2c-e5bb9bb0452a tempest-DeleteServersTestJSON-1602255744 tempest-DeleteServersTestJSON-1602255744-project] 10.222.0.23 "GET /compute/v2.1/servers/fa6eab49-6809-41fa-96c5-a6297dbe51d6" status: 404 len: 111 microversion: 2.1 time: 0.028542 Jul 12 13:29:13.387971 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 126/247] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:29:13 2022] GET /compute/v2.1/servers/fa6eab49-6809-41fa-96c5-a6297dbe51d6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 13:29:13.479024 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-dacd5c44-9388-40e4-92b8-9a6a17724466 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:29:13.479662 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-dacd5c44-9388-40e4-92b8-9a6a17724466 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: 95edada5-d3ec-4056-99e9-379fb4b65394] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:29:13.489494 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-dacd5c44-9388-40e4-92b8-9a6a17724466 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:29:13.491050 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-dacd5c44-9388-40e4-92b8-9a6a17724466 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:29:13.492103 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-dacd5c44-9388-40e4-92b8-9a6a17724466 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:29:13.492956 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-dacd5c44-9388-40e4-92b8-9a6a17724466 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:29:13.747605 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-dacd5c44-9388-40e4-92b8-9a6a17724466 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f448776d1074e22bfe6cfbe05e01db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27fe465e6743e19feec424e6e9f3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:29:13.758061 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-dacd5c44-9388-40e4-92b8-9a6a17724466 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394" status: 200 len: 1521 microversion: 2.1 time: 0.283583 Jul 12 13:29:13.759070 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 122/248] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:29:13 2022] GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394 => generated 1521 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:29:14.776633 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-8b0d655d-927d-47ca-84a2-520223501b26 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:29:14.777568 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-8b0d655d-927d-47ca-84a2-520223501b26 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: 95edada5-d3ec-4056-99e9-379fb4b65394] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:29:14.785970 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-8b0d655d-927d-47ca-84a2-520223501b26 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:29:14.786511 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-8b0d655d-927d-47ca-84a2-520223501b26 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:29:14.787649 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-8b0d655d-927d-47ca-84a2-520223501b26 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:29:14.788339 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-8b0d655d-927d-47ca-84a2-520223501b26 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:29:15.030781 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-8b0d655d-927d-47ca-84a2-520223501b26 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f448776d1074e22bfe6cfbe05e01db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27fe465e6743e19feec424e6e9f3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:29:15.068267 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-8b0d655d-927d-47ca-84a2-520223501b26 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394" status: 200 len: 1521 microversion: 2.1 time: 0.295968 Jul 12 13:29:15.077922 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 127/249] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:29:14 2022] GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394 => generated 1521 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:29:16.085980 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-c7b9224a-823d-4778-9d09-21fd73a1c428 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:29:16.087671 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-c7b9224a-823d-4778-9d09-21fd73a1c428 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: 95edada5-d3ec-4056-99e9-379fb4b65394] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:29:16.101928 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-c7b9224a-823d-4778-9d09-21fd73a1c428 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:29:16.104512 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-c7b9224a-823d-4778-9d09-21fd73a1c428 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:29:16.105839 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-c7b9224a-823d-4778-9d09-21fd73a1c428 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:29:16.108434 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-c7b9224a-823d-4778-9d09-21fd73a1c428 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:29:16.574241 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-c7b9224a-823d-4778-9d09-21fd73a1c428 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f448776d1074e22bfe6cfbe05e01db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27fe465e6743e19feec424e6e9f3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:29:16.587486 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-c7b9224a-823d-4778-9d09-21fd73a1c428 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394" status: 200 len: 1521 microversion: 2.1 time: 0.501874 Jul 12 13:29:16.588478 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 123/250] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:29:16 2022] GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394 => generated 1521 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:29:17.606399 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-5a39e6a5-ae2f-4f43-8394-fe7ac57cc0ef tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:29:17.607866 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-5a39e6a5-ae2f-4f43-8394-fe7ac57cc0ef tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: 95edada5-d3ec-4056-99e9-379fb4b65394] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:29:17.618058 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-5a39e6a5-ae2f-4f43-8394-fe7ac57cc0ef tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:29:17.619122 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-5a39e6a5-ae2f-4f43-8394-fe7ac57cc0ef tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:29:17.620215 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-5a39e6a5-ae2f-4f43-8394-fe7ac57cc0ef tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:29:17.621364 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-5a39e6a5-ae2f-4f43-8394-fe7ac57cc0ef tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:29:17.817122 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-5a39e6a5-ae2f-4f43-8394-fe7ac57cc0ef tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f448776d1074e22bfe6cfbe05e01db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27fe465e6743e19feec424e6e9f3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:29:17.828323 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG dbcounter [-] [117988] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117988) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:29:17.835150 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-5a39e6a5-ae2f-4f43-8394-fe7ac57cc0ef tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394" status: 200 len: 1521 microversion: 2.1 time: 0.234740 Jul 12 13:29:17.836037 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 128/251] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:29:17 2022] GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394 => generated 1521 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:29:18.854326 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-97fe2f5d-2b3f-42b1-9079-5ff852616cd9 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:29:18.855107 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-97fe2f5d-2b3f-42b1-9079-5ff852616cd9 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: 95edada5-d3ec-4056-99e9-379fb4b65394] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:29:18.861693 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-97fe2f5d-2b3f-42b1-9079-5ff852616cd9 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:29:18.862403 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-97fe2f5d-2b3f-42b1-9079-5ff852616cd9 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:29:18.864722 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-97fe2f5d-2b3f-42b1-9079-5ff852616cd9 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:29:18.865278 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-97fe2f5d-2b3f-42b1-9079-5ff852616cd9 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:29:19.355487 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-97fe2f5d-2b3f-42b1-9079-5ff852616cd9 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f448776d1074e22bfe6cfbe05e01db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27fe465e6743e19feec424e6e9f3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:29:19.367747 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-97fe2f5d-2b3f-42b1-9079-5ff852616cd9 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394" status: 200 len: 1521 microversion: 2.1 time: 0.518928 Jul 12 13:29:19.369906 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 124/252] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:29:18 2022] GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394 => generated 1521 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:29:19.708108 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-bdc50b81-c4ff-457d-a051-7d28bf3e1c5b tempest-VolumesGetTestJSON-1309935920 tempest-VolumesGetTestJSON-1309935920-project] Action: 'create', calling method: .version_select at 0x7f76eb82eca0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-486234301", "metadata": {"Type": "work"}}} {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:29:20.108154 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-bdc50b81-c4ff-457d-a051-7d28bf3e1c5b tempest-VolumesGetTestJSON-1309935920 tempest-VolumesGetTestJSON-1309935920-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.531167 Jul 12 13:29:20.108154 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 129/253] 10.222.0.23 () {60 vars in 1155 bytes} [Tue Jul 12 13:29:19 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 533 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 12 13:29:20.115381 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-9760d5d6-b265-4ff4-8b2e-55a09852ec32 tempest-VolumesGetTestJSON-1309935920 tempest-VolumesGetTestJSON-1309935920-project] Calling method '.version_select at 0x7f76e92c5ca0>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:29:20.184262 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-9760d5d6-b265-4ff4-8b2e-55a09852ec32 tempest-VolumesGetTestJSON-1309935920 tempest-VolumesGetTestJSON-1309935920-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/93c1f140-2115-4344-977f-366df8be3f3f" status: 200 len: 352 microversion: 2.1 time: 0.073058 Jul 12 13:29:20.184838 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 125/254] 10.222.0.23 () {58 vars in 1244 bytes} [Tue Jul 12 13:29:20 2022] GET /compute/v2.1/os-volumes/93c1f140-2115-4344-977f-366df8be3f3f => generated 352 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:29:20.392170 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-b069e344-86db-4f1b-803d-05ee2ff612ff tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:29:20.392787 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-b069e344-86db-4f1b-803d-05ee2ff612ff tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: 95edada5-d3ec-4056-99e9-379fb4b65394] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:29:20.399910 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-b069e344-86db-4f1b-803d-05ee2ff612ff tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:29:20.400458 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-b069e344-86db-4f1b-803d-05ee2ff612ff tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:29:20.401222 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-b069e344-86db-4f1b-803d-05ee2ff612ff tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:29:20.401837 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-b069e344-86db-4f1b-803d-05ee2ff612ff tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:29:20.563624 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-b069e344-86db-4f1b-803d-05ee2ff612ff tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f448776d1074e22bfe6cfbe05e01db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27fe465e6743e19feec424e6e9f3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:29:20.572062 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-b069e344-86db-4f1b-803d-05ee2ff612ff tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394" status: 200 len: 1521 microversion: 2.1 time: 0.183844 Jul 12 13:29:20.572734 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 130/255] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:29:20 2022] GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394 => generated 1521 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:29:21.200907 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-2f157308-1be3-4dc8-8a28-946e3f0b6f44 tempest-VolumesGetTestJSON-1309935920 tempest-VolumesGetTestJSON-1309935920-project] Calling method '.version_select at 0x7f76e9305700>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:29:21.259673 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-2f157308-1be3-4dc8-8a28-946e3f0b6f44 tempest-VolumesGetTestJSON-1309935920 tempest-VolumesGetTestJSON-1309935920-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/93c1f140-2115-4344-977f-366df8be3f3f" status: 200 len: 352 microversion: 2.1 time: 0.064469 Jul 12 13:29:21.260248 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 126/256] 10.222.0.23 () {58 vars in 1244 bytes} [Tue Jul 12 13:29:21 2022] GET /compute/v2.1/os-volumes/93c1f140-2115-4344-977f-366df8be3f3f => generated 352 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:29:21.589237 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-91131640-c978-4337-b8f2-8adbb3d097fb tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:29:21.589975 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-91131640-c978-4337-b8f2-8adbb3d097fb tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: 95edada5-d3ec-4056-99e9-379fb4b65394] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:29:21.597805 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-91131640-c978-4337-b8f2-8adbb3d097fb tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:29:21.598253 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-91131640-c978-4337-b8f2-8adbb3d097fb tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:29:21.599099 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-91131640-c978-4337-b8f2-8adbb3d097fb tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:29:21.599597 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-91131640-c978-4337-b8f2-8adbb3d097fb tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:29:21.752360 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-91131640-c978-4337-b8f2-8adbb3d097fb tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f448776d1074e22bfe6cfbe05e01db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27fe465e6743e19feec424e6e9f3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:29:21.760149 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-91131640-c978-4337-b8f2-8adbb3d097fb tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394" status: 200 len: 1521 microversion: 2.1 time: 0.174770 Jul 12 13:29:21.760860 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 131/257] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:29:21 2022] GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394 => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:29:22.275919 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-30f0aac7-b628-405f-af54-03a4b0f010ff tempest-VolumesGetTestJSON-1309935920 tempest-VolumesGetTestJSON-1309935920-project] Calling method '.version_select at 0x7f76e9d83550>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:29:22.329287 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-30f0aac7-b628-405f-af54-03a4b0f010ff tempest-VolumesGetTestJSON-1309935920 tempest-VolumesGetTestJSON-1309935920-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/93c1f140-2115-4344-977f-366df8be3f3f" status: 200 len: 352 microversion: 2.1 time: 0.060857 Jul 12 13:29:22.329927 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 127/258] 10.222.0.23 () {58 vars in 1244 bytes} [Tue Jul 12 13:29:22 2022] GET /compute/v2.1/os-volumes/93c1f140-2115-4344-977f-366df8be3f3f => generated 352 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:29:22.777954 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-98502811-413e-428a-ac8d-2cc3b214f667 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:29:22.778732 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-98502811-413e-428a-ac8d-2cc3b214f667 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: 95edada5-d3ec-4056-99e9-379fb4b65394] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:29:22.785618 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-98502811-413e-428a-ac8d-2cc3b214f667 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:29:22.786942 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-98502811-413e-428a-ac8d-2cc3b214f667 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:29:22.787736 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-98502811-413e-428a-ac8d-2cc3b214f667 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:29:22.788174 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-98502811-413e-428a-ac8d-2cc3b214f667 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:29:22.935235 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-98502811-413e-428a-ac8d-2cc3b214f667 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f448776d1074e22bfe6cfbe05e01db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27fe465e6743e19feec424e6e9f3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:29:22.949920 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-98502811-413e-428a-ac8d-2cc3b214f667 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394" status: 200 len: 1521 microversion: 2.1 time: 0.176064 Jul 12 13:29:22.950721 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 132/259] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:29:22 2022] GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394 => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:29:23.345451 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-ad23d2a9-fa7e-4f44-8fd8-67f33ff0c7bd tempest-VolumesGetTestJSON-1309935920 tempest-VolumesGetTestJSON-1309935920-project] Calling method '.version_select at 0x7f76e93058b0>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:29:23.395534 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-ad23d2a9-fa7e-4f44-8fd8-67f33ff0c7bd tempest-VolumesGetTestJSON-1309935920 tempest-VolumesGetTestJSON-1309935920-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/93c1f140-2115-4344-977f-366df8be3f3f" status: 200 len: 353 microversion: 2.1 time: 0.056792 Jul 12 13:29:23.396207 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 128/260] 10.222.0.23 () {58 vars in 1244 bytes} [Tue Jul 12 13:29:23 2022] GET /compute/v2.1/os-volumes/93c1f140-2115-4344-977f-366df8be3f3f => generated 353 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:29:23.407473 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-430957f4-332f-42f7-9426-e86aad3ffa6e tempest-VolumesGetTestJSON-1309935920 tempest-VolumesGetTestJSON-1309935920-project] Calling method '.version_select at 0x7f76ea345ee0>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:29:23.457015 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-430957f4-332f-42f7-9426-e86aad3ffa6e tempest-VolumesGetTestJSON-1309935920 tempest-VolumesGetTestJSON-1309935920-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/93c1f140-2115-4344-977f-366df8be3f3f" status: 200 len: 353 microversion: 2.1 time: 0.052749 Jul 12 13:29:23.457015 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 133/261] 10.222.0.23 () {58 vars in 1244 bytes} [Tue Jul 12 13:29:23 2022] GET /compute/v2.1/os-volumes/93c1f140-2115-4344-977f-366df8be3f3f => generated 353 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:29:23.473748 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-9a06c8b1-8287-4a5e-8e00-6ab5f548ee7d tempest-VolumesGetTestJSON-1309935920 tempest-VolumesGetTestJSON-1309935920-project] Calling method '.version_select at 0x7f76e931cd30>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:29:23.538721 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-9a06c8b1-8287-4a5e-8e00-6ab5f548ee7d tempest-VolumesGetTestJSON-1309935920 tempest-VolumesGetTestJSON-1309935920-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/93c1f140-2115-4344-977f-366df8be3f3f" status: 202 len: 0 microversion: 2.1 time: 0.069117 Jul 12 13:29:23.539576 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 129/262] 10.222.0.23 () {58 vars in 1247 bytes} [Tue Jul 12 13:29:23 2022] DELETE /compute/v2.1/os-volumes/93c1f140-2115-4344-977f-366df8be3f3f => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 13:29:23.548011 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-f4b6667d-3fdb-496f-8540-6edac0d84876 tempest-VolumesGetTestJSON-1309935920 tempest-VolumesGetTestJSON-1309935920-project] Calling method '.version_select at 0x7f76ea345d30>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:29:23.599627 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-f4b6667d-3fdb-496f-8540-6edac0d84876 tempest-VolumesGetTestJSON-1309935920 tempest-VolumesGetTestJSON-1309935920-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/93c1f140-2115-4344-977f-366df8be3f3f" status: 200 len: 352 microversion: 2.1 time: 0.054550 Jul 12 13:29:23.603669 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 134/263] 10.222.0.23 () {58 vars in 1244 bytes} [Tue Jul 12 13:29:23 2022] GET /compute/v2.1/os-volumes/93c1f140-2115-4344-977f-366df8be3f3f => generated 352 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:29:23.968048 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-20eaaf80-171a-4a59-a578-ce092f41ccb3 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:29:23.968655 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-20eaaf80-171a-4a59-a578-ce092f41ccb3 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: 95edada5-d3ec-4056-99e9-379fb4b65394] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:29:23.976781 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-20eaaf80-171a-4a59-a578-ce092f41ccb3 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:29:23.977231 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-20eaaf80-171a-4a59-a578-ce092f41ccb3 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:29:23.978084 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-20eaaf80-171a-4a59-a578-ce092f41ccb3 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:29:23.978638 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-20eaaf80-171a-4a59-a578-ce092f41ccb3 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:29:24.117949 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-20eaaf80-171a-4a59-a578-ce092f41ccb3 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f448776d1074e22bfe6cfbe05e01db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27fe465e6743e19feec424e6e9f3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:29:24.125296 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-20eaaf80-171a-4a59-a578-ce092f41ccb3 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394" status: 200 len: 1521 microversion: 2.1 time: 0.161128 Jul 12 13:29:24.125891 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 130/264] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:29:23 2022] GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:29:24.516652 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-f8a8c79a-10fe-4839-8d0c-337d37fdaf33 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-510574240", "imageRef": "ce5a4b61-4265-43de-a33e-a23a4c9f612d", "flavorRef": "452", "networks": [{"uuid": "e80e091e-c604-4ca6-9635-e52ad7941abc"}]}} {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:29:24.574527 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.network.neutron [None req-f8a8c79a-10fe-4839-8d0c-337d37fdaf33 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] validate_networks() for [('e80e091e-c604-4ca6-9635-e52ad7941abc', None, None, None, None, None)] {{(pid=117988) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 13:29:24.611872 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-21680e62-a0b4-41a4-b7e8-50fb6a8446ba tempest-VolumesGetTestJSON-1309935920 tempest-VolumesGetTestJSON-1309935920-project] Calling method '.version_select at 0x7f76e92c5ca0>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:29:24.645973 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.wsgi [None req-21680e62-a0b4-41a4-b7e8-50fb6a8446ba tempest-VolumesGetTestJSON-1309935920 tempest-VolumesGetTestJSON-1309935920-project] HTTP exception thrown: Volume 93c1f140-2115-4344-977f-366df8be3f3f could not be found. Jul 12 13:29:24.647938 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-21680e62-a0b4-41a4-b7e8-50fb6a8446ba tempest-VolumesGetTestJSON-1309935920 tempest-VolumesGetTestJSON-1309935920-project] Request method failure captured: Jul 12 13:29:24.647938 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: request: GET /compute/v2.1/os-volumes/93c1f140-2115-4344-977f-366df8be3f3f HTTP/1.1 Jul 12 13:29:24.647938 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: Accept: application/json Jul 12 13:29:24.647938 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: Accept-Encoding: identity Jul 12 13:29:24.647938 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: Connection: close Jul 12 13:29:24.647938 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: Content-Length: 0 Jul 12 13:29:24.647938 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: Content-Type: application/json Jul 12 13:29:24.647938 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: Host: 10.222.0.23 Jul 12 13:29:24.647938 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: Openstack-System-Scope: None Jul 12 13:29:24.647938 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: User-Agent: python-urllib3/1.26.9 Jul 12 13:29:24.647938 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Auth-Token: gAAAAABizXcvB09hlQUNmdZvearCymfimEWmmoIDZFiB5gWXBOprFCIJGUocBEVPHKponPV8hwcad9Vvju5Khp_aAR-k2uTNWJHax2YcfvcFXn5kfpEAOd2qzmw3FH0SxDwDi9WkrEdJ0EtB3rJOoNMcuUeAKtNbfViM5nDTgUgmrIlgDcbdDfM Jul 12 13:29:24.647938 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Domain-Id: None Jul 12 13:29:24.647938 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Domain-Name: None Jul 12 13:29:24.647938 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Identity-Status: Confirmed Jul 12 13:29:24.647938 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Is-Admin-Project: True Jul 12 13:29:24.647938 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Project-Domain-Id: default Jul 12 13:29:24.647938 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Project-Domain-Name: Default Jul 12 13:29:24.647938 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Project-Id: 763c7470856b43ee8b139b9050fa360a Jul 12 13:29:24.647938 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Project-Name: tempest-VolumesGetTestJSON-1309935920 Jul 12 13:29:24.647938 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Role: reader,member Jul 12 13:29:24.647938 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Roles: reader,member Jul 12 13:29:24.649176 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/763c7470856b43ee8b139b9050fa360a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_763c7470856b43ee8b139b9050fa360a", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/763c7470856b43ee8b139b9050fa360a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/763c7470856b43ee8b139b9050fa360a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] Jul 12 13:29:24.649176 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Tenant: tempest-VolumesGetTestJSON-1309935920 Jul 12 13:29:24.649176 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Tenant-Id: 763c7470856b43ee8b139b9050fa360a Jul 12 13:29:24.649176 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Tenant-Name: tempest-VolumesGetTestJSON-1309935920 Jul 12 13:29:24.649176 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-User: tempest-VolumesGetTestJSON-1309935920-project Jul 12 13:29:24.649176 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-User-Domain-Id: default Jul 12 13:29:24.649176 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-User-Domain-Name: Default Jul 12 13:29:24.649176 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-User-Id: 5bfe77d7894b4cc897f18137fa317ddc Jul 12 13:29:24.649176 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-User-Name: tempest-VolumesGetTestJSON-1309935920-project Jul 12 13:29:24.649176 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: method: Jul 12 13:29:24.649176 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: exception: Volume 93c1f140-2115-4344-977f-366df8be3f3f could not be found. Jul 12 13:29:24.649176 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: action_args: {'id': '93c1f140-2115-4344-977f-366df8be3f3f'} Jul 12 13:29:24.649176 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 13:29:24.649978 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:29:24.649978 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 13:29:24.649978 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 13:29:24.649978 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 12 13:29:24.649978 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 12 13:29:24.649978 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 12 13:29:24.649978 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 12 13:29:24.649978 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 12 13:29:24.649978 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 12 13:29:24.649978 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 12 13:29:24.649978 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 12 13:29:24.649978 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 13:29:24.649978 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 13:29:24.649978 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 13:29:24.649978 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 13:29:24.649978 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 93c1f140-2115-4344-977f-366df8be3f3f could not be found. (HTTP 404) (Request-ID: req-1a2526aa-ba3b-4921-8692-087d537c5c38) Jul 12 13:29:24.649978 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi Jul 12 13:29:24.649978 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:29:24.649978 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi Jul 12 13:29:24.651072 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:29:24.651072 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 12 13:29:24.651072 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 12 13:29:24.651072 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 12 13:29:24.651072 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 12 13:29:24.651072 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 12 13:29:24.651072 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 12 13:29:24.651072 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 12 13:29:24.651072 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 12 13:29:24.651072 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 13:29:24.651072 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 13:29:24.651072 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 12 13:29:24.651072 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 12 13:29:24.651072 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 12 13:29:24.651072 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 12 13:29:24.651072 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 12 13:29:24.651072 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 12 13:29:24.651072 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 12 13:29:24.651072 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 12 13:29:24.652038 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 13:29:24.652038 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 13:29:24.652038 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 13:29:24.652038 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 13:29:24.652038 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 93c1f140-2115-4344-977f-366df8be3f3f could not be found. Jul 12 13:29:24.652038 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi Jul 12 13:29:24.652038 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:29:24.652038 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi Jul 12 13:29:24.652038 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:29:24.652038 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:29:24.652038 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:29:24.652038 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 13:29:24.652038 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 13:29:24.652038 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 13:29:24.652038 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 13:29:24.652038 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 13:29:24.652038 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:29:24.652038 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 12 13:29:24.652038 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 13:29:24.653018 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 93c1f140-2115-4344-977f-366df8be3f3f could not be found. Jul 12 13:29:24.653018 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi Jul 12 13:29:24.653018 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:29:24.653018 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi Jul 12 13:29:24.653018 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:29:24.653018 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:29:24.653018 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:29:24.653018 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 13:29:24.653018 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 13:29:24.653018 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 93c1f140-2115-4344-977f-366df8be3f3f could not be found. Jul 12 13:29:24.653018 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi Jul 12 13:29:24.653018 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-21680e62-a0b4-41a4-b7e8-50fb6a8446ba tempest-VolumesGetTestJSON-1309935920 tempest-VolumesGetTestJSON-1309935920-project] Returning 404 to user: Volume 93c1f140-2115-4344-977f-366df8be3f3f could not be found. {{(pid=117987) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 13:29:24.653018 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-21680e62-a0b4-41a4-b7e8-50fb6a8446ba tempest-VolumesGetTestJSON-1309935920 tempest-VolumesGetTestJSON-1309935920-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/93c1f140-2115-4344-977f-366df8be3f3f" status: 404 len: 109 microversion: 2.1 time: 0.042063 Jul 12 13:29:24.653018 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 131/265] 10.222.0.23 () {58 vars in 1244 bytes} [Tue Jul 12 13:29:24 2022] GET /compute/v2.1/os-volumes/93c1f140-2115-4344-977f-366df8be3f3f => generated 109 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 12 13:29:24.998364 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.virt.hardware [None req-f8a8c79a-10fe-4839-8d0c-337d37fdaf33 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Flavor limits 0:0:0 {{(pid=117988) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 13:29:24.998934 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.virt.hardware [None req-f8a8c79a-10fe-4839-8d0c-337d37fdaf33 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Image limits 0:0:0 {{(pid=117988) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 13:29:24.999691 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.virt.hardware [None req-f8a8c79a-10fe-4839-8d0c-337d37fdaf33 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Flavor pref 0:0:0 {{(pid=117988) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 13:29:25.000344 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.virt.hardware [None req-f8a8c79a-10fe-4839-8d0c-337d37fdaf33 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Image pref 0:0:0 {{(pid=117988) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 13:29:25.000892 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.virt.hardware [None req-f8a8c79a-10fe-4839-8d0c-337d37fdaf33 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117988) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 13:29:25.012267 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-f8a8c79a-10fe-4839-8d0c-337d37fdaf33 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:29:25.012774 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-f8a8c79a-10fe-4839-8d0c-337d37fdaf33 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:29:25.013706 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-f8a8c79a-10fe-4839-8d0c-337d37fdaf33 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:29:25.014188 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-f8a8c79a-10fe-4839-8d0c-337d37fdaf33 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:29:25.031592 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.quota [None req-f8a8c79a-10fe-4839-8d0c-337d37fdaf33 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Getting quotas for project 86acb815cd62409d9856563af3037d38. Resources: {'ram', 'cores', 'instances'} {{(pid=117988) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 13:29:25.037989 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.quota [None req-f8a8c79a-10fe-4839-8d0c-337d37fdaf33 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Getting quotas for user d582e9b7a49c4ea6b9a1d6986d6f4163 and project 86acb815cd62409d9856563af3037d38. Resources: {'ram', 'cores', 'instances'} {{(pid=117988) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 13:29:25.049825 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-f8a8c79a-10fe-4839-8d0c-337d37fdaf33 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Going to run 1 instances... {{(pid=117988) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 13:29:25.052961 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-f8a8c79a-10fe-4839-8d0c-337d37fdaf33 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] [instance: e64254d9-b532-4900-ae02-13cf7c68b1d7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ce5a4b61-4265-43de-a33e-a23a4c9f612d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117988) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 13:29:25.101987 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-f8a8c79a-10fe-4839-8d0c-337d37fdaf33 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.589039 Jul 12 13:29:25.102997 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 135/266] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 12 13:29:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 591 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 13:29:25.114370 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-cddf7b73-48b9-4fdb-aa18-b569dd9dd742 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:29:25.114972 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-cddf7b73-48b9-4fdb-aa18-b569dd9dd742 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] [instance: e64254d9-b532-4900-ae02-13cf7c68b1d7] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:29:25.117848 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG dbcounter [-] [117987] Writing DB stats nova_api:SELECT=40 {{(pid=117987) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:29:25.144907 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-5d754c41-a494-4fd1-aaa7-ac99d9007465 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:29:25.146124 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-5d754c41-a494-4fd1-aaa7-ac99d9007465 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: 95edada5-d3ec-4056-99e9-379fb4b65394] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:29:25.154816 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-5d754c41-a494-4fd1-aaa7-ac99d9007465 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:29:25.155263 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-5d754c41-a494-4fd1-aaa7-ac99d9007465 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:29:25.156084 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-5d754c41-a494-4fd1-aaa7-ac99d9007465 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:29:25.156606 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-5d754c41-a494-4fd1-aaa7-ac99d9007465 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:29:25.215609 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-cddf7b73-48b9-4fdb-aa18-b569dd9dd742 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd582e9b7a49c4ea6b9a1d6986d6f4163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86acb815cd62409d9856563af3037d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:29:25.222806 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-cddf7b73-48b9-4fdb-aa18-b569dd9dd742 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] 10.222.0.23 "GET /compute/v2.1/servers/e64254d9-b532-4900-ae02-13cf7c68b1d7" status: 200 len: 1218 microversion: 2.1 time: 0.112885 Jul 12 13:29:25.236309 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 132/267] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:29:25 2022] GET /compute/v2.1/servers/e64254d9-b532-4900-ae02-13cf7c68b1d7 => generated 1218 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:29:25.381401 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-5d754c41-a494-4fd1-aaa7-ac99d9007465 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f448776d1074e22bfe6cfbe05e01db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27fe465e6743e19feec424e6e9f3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:29:25.390799 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-5d754c41-a494-4fd1-aaa7-ac99d9007465 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394" status: 200 len: 1521 microversion: 2.1 time: 0.251762 Jul 12 13:29:25.402125 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 136/268] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:29:25 2022] GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394 => generated 1521 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:29:26.246378 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-84242edb-f2e9-4d6d-ad42-801b42b2b138 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:29:26.247729 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-84242edb-f2e9-4d6d-ad42-801b42b2b138 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] [instance: e64254d9-b532-4900-ae02-13cf7c68b1d7] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:29:26.256361 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-84242edb-f2e9-4d6d-ad42-801b42b2b138 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:29:26.257089 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-84242edb-f2e9-4d6d-ad42-801b42b2b138 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:29:26.258121 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-84242edb-f2e9-4d6d-ad42-801b42b2b138 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:29:26.258949 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-84242edb-f2e9-4d6d-ad42-801b42b2b138 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:29:26.338622 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-84242edb-f2e9-4d6d-ad42-801b42b2b138 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd582e9b7a49c4ea6b9a1d6986d6f4163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86acb815cd62409d9856563af3037d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:29:26.350115 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-84242edb-f2e9-4d6d-ad42-801b42b2b138 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] 10.222.0.23 "GET /compute/v2.1/servers/e64254d9-b532-4900-ae02-13cf7c68b1d7" status: 200 len: 1270 microversion: 2.1 time: 0.109106 Jul 12 13:29:26.350697 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 133/269] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:29:26 2022] GET /compute/v2.1/servers/e64254d9-b532-4900-ae02-13cf7c68b1d7 => generated 1270 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:29:26.410196 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-35cd7749-a90c-4025-9a58-f5478d6010c0 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:29:26.411110 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-35cd7749-a90c-4025-9a58-f5478d6010c0 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: 95edada5-d3ec-4056-99e9-379fb4b65394] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:29:26.414499 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG dbcounter [-] [117988] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117988) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:29:26.422760 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-35cd7749-a90c-4025-9a58-f5478d6010c0 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:29:26.423303 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-35cd7749-a90c-4025-9a58-f5478d6010c0 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:29:26.424363 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-35cd7749-a90c-4025-9a58-f5478d6010c0 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:29:26.425848 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-35cd7749-a90c-4025-9a58-f5478d6010c0 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:29:26.691202 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-35cd7749-a90c-4025-9a58-f5478d6010c0 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f448776d1074e22bfe6cfbe05e01db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27fe465e6743e19feec424e6e9f3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:29:26.707774 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-35cd7749-a90c-4025-9a58-f5478d6010c0 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394" status: 200 len: 1521 microversion: 2.1 time: 0.301540 Jul 12 13:29:26.709727 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 137/270] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:29:26 2022] GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394 => generated 1521 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:29:27.372751 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-6325b933-e60c-49e9-895f-b1b578adb58c tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:29:27.374611 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-6325b933-e60c-49e9-895f-b1b578adb58c tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] [instance: e64254d9-b532-4900-ae02-13cf7c68b1d7] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:29:27.395764 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-6325b933-e60c-49e9-895f-b1b578adb58c tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:29:27.396719 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-6325b933-e60c-49e9-895f-b1b578adb58c tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:29:27.399592 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-6325b933-e60c-49e9-895f-b1b578adb58c tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:29:27.400141 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-6325b933-e60c-49e9-895f-b1b578adb58c tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:29:27.582109 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-6325b933-e60c-49e9-895f-b1b578adb58c tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd582e9b7a49c4ea6b9a1d6986d6f4163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86acb815cd62409d9856563af3037d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:29:27.590474 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-6325b933-e60c-49e9-895f-b1b578adb58c tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] 10.222.0.23 "GET /compute/v2.1/servers/e64254d9-b532-4900-ae02-13cf7c68b1d7" status: 200 len: 1318 microversion: 2.1 time: 0.221663 Jul 12 13:29:27.591484 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 134/271] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:29:27 2022] GET /compute/v2.1/servers/e64254d9-b532-4900-ae02-13cf7c68b1d7 => generated 1318 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:29:27.727689 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-a0a518c2-69a3-423f-8e24-3fdc7864a064 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:29:27.728309 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-a0a518c2-69a3-423f-8e24-3fdc7864a064 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: 95edada5-d3ec-4056-99e9-379fb4b65394] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:29:27.734836 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-a0a518c2-69a3-423f-8e24-3fdc7864a064 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:29:27.735309 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-a0a518c2-69a3-423f-8e24-3fdc7864a064 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:29:27.736267 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-a0a518c2-69a3-423f-8e24-3fdc7864a064 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:29:27.736708 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-a0a518c2-69a3-423f-8e24-3fdc7864a064 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:29:27.910878 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-a0a518c2-69a3-423f-8e24-3fdc7864a064 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f448776d1074e22bfe6cfbe05e01db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27fe465e6743e19feec424e6e9f3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:29:27.928302 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-a0a518c2-69a3-423f-8e24-3fdc7864a064 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394" status: 200 len: 1521 microversion: 2.1 time: 0.205992 Jul 12 13:29:27.938267 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 138/272] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:29:27 2022] GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394 => generated 1521 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:29:28.317312 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [req-aa184d91-1e14-490d-ad0f-75809524fb39 req-060f4ad4-49df-444e-b2cf-9a111544e760 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e64254d9-b532-4900-ae02-13cf7c68b1d7", "tag": "a0f2f229-d3af-4b60-9b26-bd8a0494e9f9"}]} {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:29:28.326095 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [req-aa184d91-1e14-490d-ad0f-75809524fb39 req-060f4ad4-49df-444e-b2cf-9a111544e760 service nova] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:29:28.326551 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [req-aa184d91-1e14-490d-ad0f-75809524fb39 req-060f4ad4-49df-444e-b2cf-9a111544e760 service nova] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:29:28.338968 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.compute.server_external_events [req-aa184d91-1e14-490d-ad0f-75809524fb39 req-060f4ad4-49df-444e-b2cf-9a111544e760 service nova] Creating event network-changed:a0f2f229-d3af-4b60-9b26-bd8a0494e9f9 for instance e64254d9-b532-4900-ae02-13cf7c68b1d7 on hv-cinder-82002 Jul 12 13:29:28.344779 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [req-aa184d91-1e14-490d-ad0f-75809524fb39 req-060f4ad4-49df-444e-b2cf-9a111544e760 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032025 Jul 12 13:29:28.345429 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 135/273] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 12 13:29:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:29:28.609585 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-aa29ab41-58c7-495c-8129-f03c4c359d92 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:29:28.610492 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-aa29ab41-58c7-495c-8129-f03c4c359d92 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] [instance: e64254d9-b532-4900-ae02-13cf7c68b1d7] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:29:28.618480 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-aa29ab41-58c7-495c-8129-f03c4c359d92 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:29:28.619029 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-aa29ab41-58c7-495c-8129-f03c4c359d92 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:29:28.619934 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-aa29ab41-58c7-495c-8129-f03c4c359d92 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:29:28.621334 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-aa29ab41-58c7-495c-8129-f03c4c359d92 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:29:28.794319 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-aa29ab41-58c7-495c-8129-f03c4c359d92 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd582e9b7a49c4ea6b9a1d6986d6f4163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86acb815cd62409d9856563af3037d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:29:28.803337 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-aa29ab41-58c7-495c-8129-f03c4c359d92 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] 10.222.0.23 "GET /compute/v2.1/servers/e64254d9-b532-4900-ae02-13cf7c68b1d7" status: 200 len: 1318 microversion: 2.1 time: 0.198516 Jul 12 13:29:28.803933 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 139/274] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:29:28 2022] GET /compute/v2.1/servers/e64254d9-b532-4900-ae02-13cf7c68b1d7 => generated 1318 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:29:28.949042 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-18c48942-e2d6-409f-bdf6-d8757e67aa8e tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:29:28.949781 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-18c48942-e2d6-409f-bdf6-d8757e67aa8e tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: 95edada5-d3ec-4056-99e9-379fb4b65394] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:29:28.957079 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-18c48942-e2d6-409f-bdf6-d8757e67aa8e tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:29:28.957826 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-18c48942-e2d6-409f-bdf6-d8757e67aa8e tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:29:28.958760 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-18c48942-e2d6-409f-bdf6-d8757e67aa8e tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:29:28.959377 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-18c48942-e2d6-409f-bdf6-d8757e67aa8e tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:29:29.120965 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-18c48942-e2d6-409f-bdf6-d8757e67aa8e tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f448776d1074e22bfe6cfbe05e01db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27fe465e6743e19feec424e6e9f3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:29:29.129254 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-18c48942-e2d6-409f-bdf6-d8757e67aa8e tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394" status: 200 len: 1521 microversion: 2.1 time: 0.185183 Jul 12 13:29:29.130024 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 136/275] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:29:28 2022] GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394 => generated 1521 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:29:29.821551 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-4a0fb4fa-0be3-4e53-83a5-f12ea1bfc003 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:29:29.822171 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-4a0fb4fa-0be3-4e53-83a5-f12ea1bfc003 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] [instance: e64254d9-b532-4900-ae02-13cf7c68b1d7] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:29:29.828172 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-4a0fb4fa-0be3-4e53-83a5-f12ea1bfc003 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:29:29.828615 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-4a0fb4fa-0be3-4e53-83a5-f12ea1bfc003 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:29:29.829367 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-4a0fb4fa-0be3-4e53-83a5-f12ea1bfc003 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:29:29.829819 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-4a0fb4fa-0be3-4e53-83a5-f12ea1bfc003 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:29:29.963821 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-4a0fb4fa-0be3-4e53-83a5-f12ea1bfc003 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd582e9b7a49c4ea6b9a1d6986d6f4163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86acb815cd62409d9856563af3037d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:29:29.972284 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-4a0fb4fa-0be3-4e53-83a5-f12ea1bfc003 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] 10.222.0.23 "GET /compute/v2.1/servers/e64254d9-b532-4900-ae02-13cf7c68b1d7" status: 200 len: 1318 microversion: 2.1 time: 0.154128 Jul 12 13:29:29.973050 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 140/276] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:29:29 2022] GET /compute/v2.1/servers/e64254d9-b532-4900-ae02-13cf7c68b1d7 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:29:30.147647 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-13041192-f0a1-4dae-abd0-65102e40575e tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:29:30.148445 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-13041192-f0a1-4dae-abd0-65102e40575e tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: 95edada5-d3ec-4056-99e9-379fb4b65394] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:29:30.157480 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-13041192-f0a1-4dae-abd0-65102e40575e tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:29:30.158357 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-13041192-f0a1-4dae-abd0-65102e40575e tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:29:30.159986 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-13041192-f0a1-4dae-abd0-65102e40575e tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:29:30.160797 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-13041192-f0a1-4dae-abd0-65102e40575e tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:29:30.310219 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-13041192-f0a1-4dae-abd0-65102e40575e tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f448776d1074e22bfe6cfbe05e01db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27fe465e6743e19feec424e6e9f3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:29:30.319355 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-13041192-f0a1-4dae-abd0-65102e40575e tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394" status: 200 len: 1521 microversion: 2.1 time: 0.176424 Jul 12 13:29:30.319988 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 137/277] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:29:30 2022] GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394 => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:29:30.990151 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-37df0a93-0faf-45cf-9430-09f2de9c84f2 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:29:30.990804 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-37df0a93-0faf-45cf-9430-09f2de9c84f2 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] [instance: e64254d9-b532-4900-ae02-13cf7c68b1d7] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:29:30.997021 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-37df0a93-0faf-45cf-9430-09f2de9c84f2 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:29:30.997491 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-37df0a93-0faf-45cf-9430-09f2de9c84f2 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:29:30.998256 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-37df0a93-0faf-45cf-9430-09f2de9c84f2 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:29:30.998686 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-37df0a93-0faf-45cf-9430-09f2de9c84f2 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:29:31.134226 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-37df0a93-0faf-45cf-9430-09f2de9c84f2 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd582e9b7a49c4ea6b9a1d6986d6f4163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86acb815cd62409d9856563af3037d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:29:31.142329 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-37df0a93-0faf-45cf-9430-09f2de9c84f2 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] 10.222.0.23 "GET /compute/v2.1/servers/e64254d9-b532-4900-ae02-13cf7c68b1d7" status: 200 len: 1318 microversion: 2.1 time: 0.156257 Jul 12 13:29:31.142920 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 141/278] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:29:30 2022] GET /compute/v2.1/servers/e64254d9-b532-4900-ae02-13cf7c68b1d7 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:29:31.339118 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-a2d599b5-1a71-4f2e-a2be-bf9fff865865 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:29:31.339774 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-a2d599b5-1a71-4f2e-a2be-bf9fff865865 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: 95edada5-d3ec-4056-99e9-379fb4b65394] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:29:31.346034 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-a2d599b5-1a71-4f2e-a2be-bf9fff865865 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:29:31.352542 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-a2d599b5-1a71-4f2e-a2be-bf9fff865865 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:29:31.352542 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-a2d599b5-1a71-4f2e-a2be-bf9fff865865 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:29:31.352542 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-a2d599b5-1a71-4f2e-a2be-bf9fff865865 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:29:31.353041 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG dbcounter [-] [117987] Writing DB stats nova_cell1:SELECT=100 {{(pid=117987) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:29:31.490893 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-a2d599b5-1a71-4f2e-a2be-bf9fff865865 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f448776d1074e22bfe6cfbe05e01db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27fe465e6743e19feec424e6e9f3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:29:31.499343 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-a2d599b5-1a71-4f2e-a2be-bf9fff865865 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394" status: 200 len: 1521 microversion: 2.1 time: 0.166888 Jul 12 13:29:31.500055 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 138/279] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:29:31 2022] GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394 => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:29:32.159120 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-a0ca8f0d-b006-4946-ac4d-5a289f4022eb tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:29:32.159730 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-a0ca8f0d-b006-4946-ac4d-5a289f4022eb tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] [instance: e64254d9-b532-4900-ae02-13cf7c68b1d7] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:29:32.166505 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-a0ca8f0d-b006-4946-ac4d-5a289f4022eb tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:29:32.166947 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-a0ca8f0d-b006-4946-ac4d-5a289f4022eb tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:29:32.167705 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-a0ca8f0d-b006-4946-ac4d-5a289f4022eb tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:29:32.168139 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-a0ca8f0d-b006-4946-ac4d-5a289f4022eb tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:29:32.302592 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-a0ca8f0d-b006-4946-ac4d-5a289f4022eb tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd582e9b7a49c4ea6b9a1d6986d6f4163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86acb815cd62409d9856563af3037d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:29:32.311896 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-a0ca8f0d-b006-4946-ac4d-5a289f4022eb tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] 10.222.0.23 "GET /compute/v2.1/servers/e64254d9-b532-4900-ae02-13cf7c68b1d7" status: 200 len: 1318 microversion: 2.1 time: 0.156521 Jul 12 13:29:32.312471 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 142/280] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:29:32 2022] GET /compute/v2.1/servers/e64254d9-b532-4900-ae02-13cf7c68b1d7 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:29:32.517712 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-3e582165-9d05-4541-830b-0ddb139f25ae tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:29:32.518341 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-3e582165-9d05-4541-830b-0ddb139f25ae tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: 95edada5-d3ec-4056-99e9-379fb4b65394] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:29:32.525711 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-3e582165-9d05-4541-830b-0ddb139f25ae tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:29:32.526169 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-3e582165-9d05-4541-830b-0ddb139f25ae tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:29:32.526910 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-3e582165-9d05-4541-830b-0ddb139f25ae tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:29:32.527338 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-3e582165-9d05-4541-830b-0ddb139f25ae tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:29:32.665328 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-3e582165-9d05-4541-830b-0ddb139f25ae tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f448776d1074e22bfe6cfbe05e01db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27fe465e6743e19feec424e6e9f3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:29:32.673299 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-3e582165-9d05-4541-830b-0ddb139f25ae tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394" status: 200 len: 1521 microversion: 2.1 time: 0.159404 Jul 12 13:29:32.673912 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 139/281] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:29:32 2022] GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:29:33.330184 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-c2490e8b-7187-4397-a275-74d6a4075476 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:29:33.330837 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-c2490e8b-7187-4397-a275-74d6a4075476 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] [instance: e64254d9-b532-4900-ae02-13cf7c68b1d7] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:29:33.339220 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-c2490e8b-7187-4397-a275-74d6a4075476 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:29:33.339899 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-c2490e8b-7187-4397-a275-74d6a4075476 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:29:33.340784 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-c2490e8b-7187-4397-a275-74d6a4075476 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:29:33.341220 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-c2490e8b-7187-4397-a275-74d6a4075476 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:29:33.478975 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-c2490e8b-7187-4397-a275-74d6a4075476 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd582e9b7a49c4ea6b9a1d6986d6f4163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86acb815cd62409d9856563af3037d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:29:33.486267 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-c2490e8b-7187-4397-a275-74d6a4075476 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] 10.222.0.23 "GET /compute/v2.1/servers/e64254d9-b532-4900-ae02-13cf7c68b1d7" status: 200 len: 1318 microversion: 2.1 time: 0.159967 Jul 12 13:29:33.486821 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 143/282] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:29:33 2022] GET /compute/v2.1/servers/e64254d9-b532-4900-ae02-13cf7c68b1d7 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:29:33.695920 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-0185a803-b116-4217-9501-adf3e7feffb3 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:29:33.696544 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-0185a803-b116-4217-9501-adf3e7feffb3 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: 95edada5-d3ec-4056-99e9-379fb4b65394] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:29:33.706071 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-0185a803-b116-4217-9501-adf3e7feffb3 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:29:33.706756 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-0185a803-b116-4217-9501-adf3e7feffb3 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:29:33.707864 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-0185a803-b116-4217-9501-adf3e7feffb3 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:29:33.709283 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-0185a803-b116-4217-9501-adf3e7feffb3 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:29:33.857269 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-0185a803-b116-4217-9501-adf3e7feffb3 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f448776d1074e22bfe6cfbe05e01db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27fe465e6743e19feec424e6e9f3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:29:33.865159 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-0185a803-b116-4217-9501-adf3e7feffb3 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394" status: 200 len: 1521 microversion: 2.1 time: 0.173847 Jul 12 13:29:33.866455 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 140/283] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:29:33 2022] GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394 => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:29:34.504707 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-2cd50550-b5ee-4354-a02b-ec248834f52b tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:29:34.507652 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-2cd50550-b5ee-4354-a02b-ec248834f52b tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] [instance: e64254d9-b532-4900-ae02-13cf7c68b1d7] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:29:34.515915 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-2cd50550-b5ee-4354-a02b-ec248834f52b tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:29:34.516752 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-2cd50550-b5ee-4354-a02b-ec248834f52b tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:29:34.517972 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-2cd50550-b5ee-4354-a02b-ec248834f52b tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:29:34.519167 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-2cd50550-b5ee-4354-a02b-ec248834f52b tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:29:34.705680 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-2cd50550-b5ee-4354-a02b-ec248834f52b tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd582e9b7a49c4ea6b9a1d6986d6f4163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86acb815cd62409d9856563af3037d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:29:34.714782 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-2cd50550-b5ee-4354-a02b-ec248834f52b tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] 10.222.0.23 "GET /compute/v2.1/servers/e64254d9-b532-4900-ae02-13cf7c68b1d7" status: 200 len: 1318 microversion: 2.1 time: 0.214354 Jul 12 13:29:34.715360 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 144/284] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:29:34 2022] GET /compute/v2.1/servers/e64254d9-b532-4900-ae02-13cf7c68b1d7 => generated 1318 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:29:34.884002 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-a79dd3f8-f667-4565-b87c-338585454e68 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:29:34.884605 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-a79dd3f8-f667-4565-b87c-338585454e68 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: 95edada5-d3ec-4056-99e9-379fb4b65394] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:29:34.891312 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-a79dd3f8-f667-4565-b87c-338585454e68 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:29:34.891753 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-a79dd3f8-f667-4565-b87c-338585454e68 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:29:34.892516 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-a79dd3f8-f667-4565-b87c-338585454e68 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:29:34.892945 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-a79dd3f8-f667-4565-b87c-338585454e68 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:29:35.026176 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-a79dd3f8-f667-4565-b87c-338585454e68 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f448776d1074e22bfe6cfbe05e01db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27fe465e6743e19feec424e6e9f3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:29:35.034070 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-a79dd3f8-f667-4565-b87c-338585454e68 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394" status: 200 len: 1521 microversion: 2.1 time: 0.154096 Jul 12 13:29:35.034654 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 141/285] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:29:34 2022] GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:29:35.233896 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [req-7a39796c-9853-47de-a198-855fa827cfba req-54dfbbc7-8b4c-4ca7-b43a-1972ffa9f737 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e64254d9-b532-4900-ae02-13cf7c68b1d7", "name": "network-vif-plugged", "status": "completed", "tag": "a0f2f229-d3af-4b60-9b26-bd8a0494e9f9"}]} {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:29:35.237966 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG dbcounter [-] [117988] Writing DB stats nova_cell0:SELECT=2 {{(pid=117988) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:29:35.238623 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG dbcounter [-] [117988] Writing DB stats nova_cell0:SELECT=6 {{(pid=117988) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:29:35.245616 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [req-7a39796c-9853-47de-a198-855fa827cfba req-54dfbbc7-8b4c-4ca7-b43a-1972ffa9f737 service nova] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:29:35.246057 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [req-7a39796c-9853-47de-a198-855fa827cfba req-54dfbbc7-8b4c-4ca7-b43a-1972ffa9f737 service nova] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:29:35.259146 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.compute.server_external_events [req-7a39796c-9853-47de-a198-855fa827cfba req-54dfbbc7-8b4c-4ca7-b43a-1972ffa9f737 service nova] Creating event network-vif-plugged:a0f2f229-d3af-4b60-9b26-bd8a0494e9f9 for instance e64254d9-b532-4900-ae02-13cf7c68b1d7 on hv-cinder-82002 Jul 12 13:29:35.264458 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [req-7a39796c-9853-47de-a198-855fa827cfba req-54dfbbc7-8b4c-4ca7-b43a-1972ffa9f737 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034478 Jul 12 13:29:35.265064 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 145/286] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 12 13:29:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:29:35.737189 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-7a2241a2-1495-467e-ba4c-4655dd2bc4ba tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:29:35.737828 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-7a2241a2-1495-467e-ba4c-4655dd2bc4ba tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] [instance: e64254d9-b532-4900-ae02-13cf7c68b1d7] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:29:35.739708 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG dbcounter [-] [117987] Writing DB stats nova_cell0:SELECT=2 {{(pid=117987) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:29:35.745829 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-7a2241a2-1495-467e-ba4c-4655dd2bc4ba tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:29:35.746271 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-7a2241a2-1495-467e-ba4c-4655dd2bc4ba tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:29:35.747033 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-7a2241a2-1495-467e-ba4c-4655dd2bc4ba tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:29:35.747461 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-7a2241a2-1495-467e-ba4c-4655dd2bc4ba tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:29:35.888129 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-7a2241a2-1495-467e-ba4c-4655dd2bc4ba tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd582e9b7a49c4ea6b9a1d6986d6f4163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86acb815cd62409d9856563af3037d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:29:35.897561 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-7a2241a2-1495-467e-ba4c-4655dd2bc4ba tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] 10.222.0.23 "GET /compute/v2.1/servers/e64254d9-b532-4900-ae02-13cf7c68b1d7" status: 200 len: 1318 microversion: 2.1 time: 0.163454 Jul 12 13:29:35.900271 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 142/287] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:29:35 2022] GET /compute/v2.1/servers/e64254d9-b532-4900-ae02-13cf7c68b1d7 => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:29:36.054034 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-fe090e87-2d77-4c96-ad58-55b93031a6ef tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:29:36.054851 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-fe090e87-2d77-4c96-ad58-55b93031a6ef tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: 95edada5-d3ec-4056-99e9-379fb4b65394] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:29:36.061889 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-fe090e87-2d77-4c96-ad58-55b93031a6ef tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:29:36.062328 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-fe090e87-2d77-4c96-ad58-55b93031a6ef tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:29:36.063355 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-fe090e87-2d77-4c96-ad58-55b93031a6ef tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:29:36.063781 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-fe090e87-2d77-4c96-ad58-55b93031a6ef tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:29:36.213692 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-fe090e87-2d77-4c96-ad58-55b93031a6ef tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f448776d1074e22bfe6cfbe05e01db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27fe465e6743e19feec424e6e9f3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:29:36.222237 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-fe090e87-2d77-4c96-ad58-55b93031a6ef tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394" status: 200 len: 1521 microversion: 2.1 time: 0.173600 Jul 12 13:29:36.223055 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 146/288] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:29:36 2022] GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394 => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:29:36.916313 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-9990e309-2070-45e8-a547-e4aab898d6a5 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:29:36.916970 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-9990e309-2070-45e8-a547-e4aab898d6a5 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] [instance: e64254d9-b532-4900-ae02-13cf7c68b1d7] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:29:36.924000 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-9990e309-2070-45e8-a547-e4aab898d6a5 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:29:36.924838 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-9990e309-2070-45e8-a547-e4aab898d6a5 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:29:36.925252 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-9990e309-2070-45e8-a547-e4aab898d6a5 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:29:36.925724 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-9990e309-2070-45e8-a547-e4aab898d6a5 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:29:37.132626 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-9990e309-2070-45e8-a547-e4aab898d6a5 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd582e9b7a49c4ea6b9a1d6986d6f4163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86acb815cd62409d9856563af3037d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:29:37.140646 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-9990e309-2070-45e8-a547-e4aab898d6a5 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] 10.222.0.23 "GET /compute/v2.1/servers/e64254d9-b532-4900-ae02-13cf7c68b1d7" status: 200 len: 1318 microversion: 2.1 time: 0.228798 Jul 12 13:29:37.141204 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 143/289] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:29:36 2022] GET /compute/v2.1/servers/e64254d9-b532-4900-ae02-13cf7c68b1d7 => generated 1318 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:29:37.240888 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-88fe7d7d-82db-43a3-9d3c-ddf21842017a tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:29:37.241653 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-88fe7d7d-82db-43a3-9d3c-ddf21842017a tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: 95edada5-d3ec-4056-99e9-379fb4b65394] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:29:37.249163 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-88fe7d7d-82db-43a3-9d3c-ddf21842017a tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:29:37.249636 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-88fe7d7d-82db-43a3-9d3c-ddf21842017a tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:29:37.250404 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-88fe7d7d-82db-43a3-9d3c-ddf21842017a tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:29:37.250829 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-88fe7d7d-82db-43a3-9d3c-ddf21842017a tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:29:37.429009 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-88fe7d7d-82db-43a3-9d3c-ddf21842017a tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f448776d1074e22bfe6cfbe05e01db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27fe465e6743e19feec424e6e9f3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:29:37.437533 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-88fe7d7d-82db-43a3-9d3c-ddf21842017a tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394" status: 200 len: 1501 microversion: 2.1 time: 0.200579 Jul 12 13:29:37.438371 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 147/290] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:29:37 2022] GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394 => generated 1501 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:29:37.455091 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-e9b34fec-9f6e-498a-88a4-3841088a93e4 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:29:37.455727 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-e9b34fec-9f6e-498a-88a4-3841088a93e4 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: bf8dbed9-b15d-4daf-af11-7ee001424482] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:29:37.463285 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-e9b34fec-9f6e-498a-88a4-3841088a93e4 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:29:37.463837 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-e9b34fec-9f6e-498a-88a4-3841088a93e4 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:29:37.465178 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-e9b34fec-9f6e-498a-88a4-3841088a93e4 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:29:37.465846 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-e9b34fec-9f6e-498a-88a4-3841088a93e4 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:29:37.615748 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-e9b34fec-9f6e-498a-88a4-3841088a93e4 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f448776d1074e22bfe6cfbe05e01db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27fe465e6743e19feec424e6e9f3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:29:37.624254 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-e9b34fec-9f6e-498a-88a4-3841088a93e4 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "GET /compute/v2.1/servers/bf8dbed9-b15d-4daf-af11-7ee001424482" status: 200 len: 1517 microversion: 2.1 time: 0.173140 Jul 12 13:29:37.624934 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 144/291] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:29:37 2022] GET /compute/v2.1/servers/bf8dbed9-b15d-4daf-af11-7ee001424482 => generated 1517 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:29:38.164673 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-d97343db-562e-432f-a8c8-031da107d9ee tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:29:38.165356 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-d97343db-562e-432f-a8c8-031da107d9ee tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] [instance: e64254d9-b532-4900-ae02-13cf7c68b1d7] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:29:38.171905 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-d97343db-562e-432f-a8c8-031da107d9ee tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:29:38.172254 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-d97343db-562e-432f-a8c8-031da107d9ee tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:29:38.173032 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-d97343db-562e-432f-a8c8-031da107d9ee tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:29:38.173502 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-d97343db-562e-432f-a8c8-031da107d9ee tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:29:38.312371 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-d97343db-562e-432f-a8c8-031da107d9ee tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd582e9b7a49c4ea6b9a1d6986d6f4163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86acb815cd62409d9856563af3037d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:29:38.321586 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-d97343db-562e-432f-a8c8-031da107d9ee tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] 10.222.0.23 "GET /compute/v2.1/servers/e64254d9-b532-4900-ae02-13cf7c68b1d7" status: 200 len: 1506 microversion: 2.1 time: 0.161609 Jul 12 13:29:38.322267 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 148/292] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:29:38 2022] GET /compute/v2.1/servers/e64254d9-b532-4900-ae02-13cf7c68b1d7 => generated 1506 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:29:40.128744 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-74cca1d1-d176-4eca-a15e-2c74013220c2 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:29:40.129718 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-74cca1d1-d176-4eca-a15e-2c74013220c2 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: bf8dbed9-b15d-4daf-af11-7ee001424482] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:29:40.137094 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-74cca1d1-d176-4eca-a15e-2c74013220c2 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:29:40.137611 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-74cca1d1-d176-4eca-a15e-2c74013220c2 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:29:40.138372 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-74cca1d1-d176-4eca-a15e-2c74013220c2 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:29:40.138800 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-74cca1d1-d176-4eca-a15e-2c74013220c2 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:29:40.162372 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.objects.instance [None req-74cca1d1-d176-4eca-a15e-2c74013220c2 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lazy-loading 'flavor' on Instance uuid bf8dbed9-b15d-4daf-af11-7ee001424482 {{(pid=117987) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 13:29:40.237263 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-74cca1d1-d176-4eca-a15e-2c74013220c2 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "POST /compute/v2.1/servers/bf8dbed9-b15d-4daf-af11-7ee001424482/action" status: 200 len: 32 microversion: 2.1 time: 0.112494 Jul 12 13:29:40.237930 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 145/293] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 12 13:29:40 2022] POST /compute/v2.1/servers/bf8dbed9-b15d-4daf-af11-7ee001424482/action => generated 32 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 12 13:29:40.247352 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-080e5b20-0dd3-44ee-80e6-e1a04c930eac tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:29:40.248045 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-080e5b20-0dd3-44ee-80e6-e1a04c930eac tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: bf8dbed9-b15d-4daf-af11-7ee001424482] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:29:40.254695 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-080e5b20-0dd3-44ee-80e6-e1a04c930eac tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:29:40.255153 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-080e5b20-0dd3-44ee-80e6-e1a04c930eac tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:29:40.255905 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-080e5b20-0dd3-44ee-80e6-e1a04c930eac tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:29:40.256337 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-080e5b20-0dd3-44ee-80e6-e1a04c930eac tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:29:40.399411 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-080e5b20-0dd3-44ee-80e6-e1a04c930eac tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f448776d1074e22bfe6cfbe05e01db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27fe465e6743e19feec424e6e9f3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:29:40.402954 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG dbcounter [-] [117988] Writing DB stats nova_cell1:SELECT=100 {{(pid=117988) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:29:40.407666 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-080e5b20-0dd3-44ee-80e6-e1a04c930eac tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "GET /compute/v2.1/servers/bf8dbed9-b15d-4daf-af11-7ee001424482" status: 200 len: 1523 microversion: 2.1 time: 0.164060 Jul 12 13:29:40.408272 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 149/294] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:29:40 2022] GET /compute/v2.1/servers/bf8dbed9-b15d-4daf-af11-7ee001424482 => generated 1523 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:29:41.427081 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-190915cd-fe36-49c1-a464-f55b9ada6038 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:29:41.427807 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-190915cd-fe36-49c1-a464-f55b9ada6038 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: bf8dbed9-b15d-4daf-af11-7ee001424482] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:29:41.434693 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-190915cd-fe36-49c1-a464-f55b9ada6038 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:29:41.435136 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-190915cd-fe36-49c1-a464-f55b9ada6038 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:29:41.435904 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-190915cd-fe36-49c1-a464-f55b9ada6038 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:29:41.436344 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-190915cd-fe36-49c1-a464-f55b9ada6038 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:29:41.586767 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-190915cd-fe36-49c1-a464-f55b9ada6038 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f448776d1074e22bfe6cfbe05e01db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27fe465e6743e19feec424e6e9f3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:29:41.594488 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-190915cd-fe36-49c1-a464-f55b9ada6038 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "GET /compute/v2.1/servers/bf8dbed9-b15d-4daf-af11-7ee001424482" status: 200 len: 1523 microversion: 2.1 time: 0.172460 Jul 12 13:29:41.595063 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 146/295] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:29:41 2022] GET /compute/v2.1/servers/bf8dbed9-b15d-4daf-af11-7ee001424482 => generated 1523 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:29:42.612223 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-c3a8a615-f251-46a3-8cbc-c590def05373 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:29:42.612839 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-c3a8a615-f251-46a3-8cbc-c590def05373 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: bf8dbed9-b15d-4daf-af11-7ee001424482] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:29:42.620627 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-c3a8a615-f251-46a3-8cbc-c590def05373 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:29:42.621079 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-c3a8a615-f251-46a3-8cbc-c590def05373 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:29:42.621876 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-c3a8a615-f251-46a3-8cbc-c590def05373 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:29:42.622311 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-c3a8a615-f251-46a3-8cbc-c590def05373 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:29:42.757514 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-c3a8a615-f251-46a3-8cbc-c590def05373 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f448776d1074e22bfe6cfbe05e01db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27fe465e6743e19feec424e6e9f3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:29:42.765755 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-c3a8a615-f251-46a3-8cbc-c590def05373 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "GET /compute/v2.1/servers/bf8dbed9-b15d-4daf-af11-7ee001424482" status: 200 len: 1523 microversion: 2.1 time: 0.157379 Jul 12 13:29:42.766464 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 150/296] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:29:42 2022] GET /compute/v2.1/servers/bf8dbed9-b15d-4daf-af11-7ee001424482 => generated 1523 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:29:43.783233 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-b8b99f28-d947-4cd8-8a6e-987f663665bd tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:29:43.784090 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-b8b99f28-d947-4cd8-8a6e-987f663665bd tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: bf8dbed9-b15d-4daf-af11-7ee001424482] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:29:43.792338 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-b8b99f28-d947-4cd8-8a6e-987f663665bd tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:29:43.792869 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-b8b99f28-d947-4cd8-8a6e-987f663665bd tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:29:43.793679 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-b8b99f28-d947-4cd8-8a6e-987f663665bd tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:29:43.794122 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-b8b99f28-d947-4cd8-8a6e-987f663665bd tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:29:43.936819 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-b8b99f28-d947-4cd8-8a6e-987f663665bd tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f448776d1074e22bfe6cfbe05e01db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27fe465e6743e19feec424e6e9f3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:29:43.944652 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-b8b99f28-d947-4cd8-8a6e-987f663665bd tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "GET /compute/v2.1/servers/bf8dbed9-b15d-4daf-af11-7ee001424482" status: 200 len: 1523 microversion: 2.1 time: 0.165291 Jul 12 13:29:43.945216 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 147/297] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:29:43 2022] GET /compute/v2.1/servers/bf8dbed9-b15d-4daf-af11-7ee001424482 => generated 1523 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:29:44.962467 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-7a179334-eea9-447a-9323-f94c1c15a694 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:29:44.963081 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-7a179334-eea9-447a-9323-f94c1c15a694 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: bf8dbed9-b15d-4daf-af11-7ee001424482] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:29:44.969080 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-7a179334-eea9-447a-9323-f94c1c15a694 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:29:44.969565 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-7a179334-eea9-447a-9323-f94c1c15a694 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:29:44.970396 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-7a179334-eea9-447a-9323-f94c1c15a694 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:29:44.970834 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-7a179334-eea9-447a-9323-f94c1c15a694 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:29:45.109669 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-7a179334-eea9-447a-9323-f94c1c15a694 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f448776d1074e22bfe6cfbe05e01db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27fe465e6743e19feec424e6e9f3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:29:45.118590 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-7a179334-eea9-447a-9323-f94c1c15a694 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "GET /compute/v2.1/servers/bf8dbed9-b15d-4daf-af11-7ee001424482" status: 200 len: 1523 microversion: 2.1 time: 0.160921 Jul 12 13:29:45.119726 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 151/298] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:29:44 2022] GET /compute/v2.1/servers/bf8dbed9-b15d-4daf-af11-7ee001424482 => generated 1523 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:29:46.136354 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-55dde14a-f8b7-4d4c-89db-c6cfa2000e19 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:29:46.136963 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-55dde14a-f8b7-4d4c-89db-c6cfa2000e19 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: bf8dbed9-b15d-4daf-af11-7ee001424482] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:29:46.143435 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-55dde14a-f8b7-4d4c-89db-c6cfa2000e19 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:29:46.143877 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-55dde14a-f8b7-4d4c-89db-c6cfa2000e19 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:29:46.144636 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-55dde14a-f8b7-4d4c-89db-c6cfa2000e19 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:29:46.145066 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-55dde14a-f8b7-4d4c-89db-c6cfa2000e19 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:29:46.292153 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-55dde14a-f8b7-4d4c-89db-c6cfa2000e19 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f448776d1074e22bfe6cfbe05e01db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27fe465e6743e19feec424e6e9f3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:29:46.299612 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-55dde14a-f8b7-4d4c-89db-c6cfa2000e19 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "GET /compute/v2.1/servers/bf8dbed9-b15d-4daf-af11-7ee001424482" status: 200 len: 1523 microversion: 2.1 time: 0.167110 Jul 12 13:29:46.300190 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 148/299] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:29:46 2022] GET /compute/v2.1/servers/bf8dbed9-b15d-4daf-af11-7ee001424482 => generated 1523 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:29:47.317921 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-c12b6e8b-3ba5-4ab1-ae0a-a928ef7486ee tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:29:47.318570 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-c12b6e8b-3ba5-4ab1-ae0a-a928ef7486ee tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: bf8dbed9-b15d-4daf-af11-7ee001424482] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:29:47.325421 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-c12b6e8b-3ba5-4ab1-ae0a-a928ef7486ee tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:29:47.325851 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-c12b6e8b-3ba5-4ab1-ae0a-a928ef7486ee tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:29:47.326600 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-c12b6e8b-3ba5-4ab1-ae0a-a928ef7486ee tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:29:47.327024 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-c12b6e8b-3ba5-4ab1-ae0a-a928ef7486ee tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:29:47.461654 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-c12b6e8b-3ba5-4ab1-ae0a-a928ef7486ee tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f448776d1074e22bfe6cfbe05e01db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27fe465e6743e19feec424e6e9f3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:29:47.469688 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-c12b6e8b-3ba5-4ab1-ae0a-a928ef7486ee tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "GET /compute/v2.1/servers/bf8dbed9-b15d-4daf-af11-7ee001424482" status: 200 len: 1523 microversion: 2.1 time: 0.155542 Jul 12 13:29:47.470378 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 152/300] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:29:47 2022] GET /compute/v2.1/servers/bf8dbed9-b15d-4daf-af11-7ee001424482 => generated 1523 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:29:48.487374 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-ea0f3d00-f868-4cda-b604-21d33c9cffdf tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:29:48.488193 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-ea0f3d00-f868-4cda-b604-21d33c9cffdf tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: bf8dbed9-b15d-4daf-af11-7ee001424482] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:29:48.495221 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-ea0f3d00-f868-4cda-b604-21d33c9cffdf tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:29:48.495625 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-ea0f3d00-f868-4cda-b604-21d33c9cffdf tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:29:48.496905 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-ea0f3d00-f868-4cda-b604-21d33c9cffdf tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:29:48.497054 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-ea0f3d00-f868-4cda-b604-21d33c9cffdf tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:29:48.636066 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-ea0f3d00-f868-4cda-b604-21d33c9cffdf tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f448776d1074e22bfe6cfbe05e01db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27fe465e6743e19feec424e6e9f3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:29:48.643646 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-ea0f3d00-f868-4cda-b604-21d33c9cffdf tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "GET /compute/v2.1/servers/bf8dbed9-b15d-4daf-af11-7ee001424482" status: 200 len: 1523 microversion: 2.1 time: 0.160265 Jul 12 13:29:48.644217 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 149/301] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:29:48 2022] GET /compute/v2.1/servers/bf8dbed9-b15d-4daf-af11-7ee001424482 => generated 1523 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:29:49.660082 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-70833d29-d6e6-4baf-9e3d-047f0f92a1fb tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:29:49.661310 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-70833d29-d6e6-4baf-9e3d-047f0f92a1fb tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: bf8dbed9-b15d-4daf-af11-7ee001424482] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:29:49.668862 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-70833d29-d6e6-4baf-9e3d-047f0f92a1fb tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:29:49.669571 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-70833d29-d6e6-4baf-9e3d-047f0f92a1fb tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:29:49.670810 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-70833d29-d6e6-4baf-9e3d-047f0f92a1fb tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:29:49.682484 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-70833d29-d6e6-4baf-9e3d-047f0f92a1fb tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:29:49.839324 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-70833d29-d6e6-4baf-9e3d-047f0f92a1fb tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f448776d1074e22bfe6cfbe05e01db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27fe465e6743e19feec424e6e9f3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:29:49.847519 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-70833d29-d6e6-4baf-9e3d-047f0f92a1fb tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "GET /compute/v2.1/servers/bf8dbed9-b15d-4daf-af11-7ee001424482" status: 200 len: 1523 microversion: 2.1 time: 0.191256 Jul 12 13:29:49.848107 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 153/302] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:29:49 2022] GET /compute/v2.1/servers/bf8dbed9-b15d-4daf-af11-7ee001424482 => generated 1523 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:29:50.864559 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-899f23ed-1a7e-4f45-91f0-16ab14a03487 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:29:50.866429 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-899f23ed-1a7e-4f45-91f0-16ab14a03487 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: bf8dbed9-b15d-4daf-af11-7ee001424482] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:29:50.872805 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-899f23ed-1a7e-4f45-91f0-16ab14a03487 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:29:50.873254 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-899f23ed-1a7e-4f45-91f0-16ab14a03487 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:29:50.874052 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-899f23ed-1a7e-4f45-91f0-16ab14a03487 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:29:50.874486 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-899f23ed-1a7e-4f45-91f0-16ab14a03487 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:29:51.026385 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-899f23ed-1a7e-4f45-91f0-16ab14a03487 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f448776d1074e22bfe6cfbe05e01db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27fe465e6743e19feec424e6e9f3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:29:51.034279 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-899f23ed-1a7e-4f45-91f0-16ab14a03487 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "GET /compute/v2.1/servers/bf8dbed9-b15d-4daf-af11-7ee001424482" status: 200 len: 1523 microversion: 2.1 time: 0.173885 Jul 12 13:29:51.035210 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 150/303] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:29:50 2022] GET /compute/v2.1/servers/bf8dbed9-b15d-4daf-af11-7ee001424482 => generated 1523 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:29:52.052887 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-22a0eeab-28a6-4434-b97e-02d7858ab878 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:29:52.054030 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-22a0eeab-28a6-4434-b97e-02d7858ab878 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: bf8dbed9-b15d-4daf-af11-7ee001424482] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:29:52.061228 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-22a0eeab-28a6-4434-b97e-02d7858ab878 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:29:52.061473 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-22a0eeab-28a6-4434-b97e-02d7858ab878 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:29:52.062234 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-22a0eeab-28a6-4434-b97e-02d7858ab878 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:29:52.062660 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-22a0eeab-28a6-4434-b97e-02d7858ab878 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:29:52.205744 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-22a0eeab-28a6-4434-b97e-02d7858ab878 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f448776d1074e22bfe6cfbe05e01db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27fe465e6743e19feec424e6e9f3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:29:52.215608 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-22a0eeab-28a6-4434-b97e-02d7858ab878 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "GET /compute/v2.1/servers/bf8dbed9-b15d-4daf-af11-7ee001424482" status: 200 len: 1523 microversion: 2.1 time: 0.166491 Jul 12 13:29:52.216922 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 154/304] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:29:52 2022] GET /compute/v2.1/servers/bf8dbed9-b15d-4daf-af11-7ee001424482 => generated 1523 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:29:53.233754 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-dd4988e4-62f9-4bd2-9add-6f216edb98fb tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:29:53.234372 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-dd4988e4-62f9-4bd2-9add-6f216edb98fb tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: bf8dbed9-b15d-4daf-af11-7ee001424482] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:29:53.241878 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-dd4988e4-62f9-4bd2-9add-6f216edb98fb tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:29:53.242326 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-dd4988e4-62f9-4bd2-9add-6f216edb98fb tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:29:53.243107 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-dd4988e4-62f9-4bd2-9add-6f216edb98fb tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:29:53.243543 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-dd4988e4-62f9-4bd2-9add-6f216edb98fb tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:29:53.383586 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-dd4988e4-62f9-4bd2-9add-6f216edb98fb tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f448776d1074e22bfe6cfbe05e01db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27fe465e6743e19feec424e6e9f3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:29:53.391122 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-dd4988e4-62f9-4bd2-9add-6f216edb98fb tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "GET /compute/v2.1/servers/bf8dbed9-b15d-4daf-af11-7ee001424482" status: 200 len: 1523 microversion: 2.1 time: 0.161351 Jul 12 13:29:53.391702 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 151/305] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:29:53 2022] GET /compute/v2.1/servers/bf8dbed9-b15d-4daf-af11-7ee001424482 => generated 1523 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:29:54.409257 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-729ce194-bc6a-4a47-9005-517001d13f9e tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:29:54.409896 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-729ce194-bc6a-4a47-9005-517001d13f9e tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: bf8dbed9-b15d-4daf-af11-7ee001424482] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:29:54.417320 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-729ce194-bc6a-4a47-9005-517001d13f9e tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:29:54.417815 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-729ce194-bc6a-4a47-9005-517001d13f9e tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:29:54.418592 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-729ce194-bc6a-4a47-9005-517001d13f9e tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:29:54.419030 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-729ce194-bc6a-4a47-9005-517001d13f9e tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:29:54.558134 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-729ce194-bc6a-4a47-9005-517001d13f9e tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f448776d1074e22bfe6cfbe05e01db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27fe465e6743e19feec424e6e9f3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:29:54.566129 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-729ce194-bc6a-4a47-9005-517001d13f9e tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "GET /compute/v2.1/servers/bf8dbed9-b15d-4daf-af11-7ee001424482" status: 200 len: 1523 microversion: 2.1 time: 0.160691 Jul 12 13:29:54.566725 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 155/306] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:29:54 2022] GET /compute/v2.1/servers/bf8dbed9-b15d-4daf-af11-7ee001424482 => generated 1523 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:29:55.583971 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-e6f03697-762b-435f-8367-e3008e0e3072 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:29:55.585155 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-e6f03697-762b-435f-8367-e3008e0e3072 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: bf8dbed9-b15d-4daf-af11-7ee001424482] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:29:55.587872 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG dbcounter [-] [117987] Writing DB stats nova_api:SELECT=42 {{(pid=117987) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:29:55.593196 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-e6f03697-762b-435f-8367-e3008e0e3072 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:29:55.593686 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-e6f03697-762b-435f-8367-e3008e0e3072 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:29:55.594464 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-e6f03697-762b-435f-8367-e3008e0e3072 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:29:55.594902 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-e6f03697-762b-435f-8367-e3008e0e3072 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:29:55.861687 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-e6f03697-762b-435f-8367-e3008e0e3072 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f448776d1074e22bfe6cfbe05e01db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27fe465e6743e19feec424e6e9f3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:29:55.865092 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG dbcounter [-] [117987] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117987) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:29:55.875511 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-e6f03697-762b-435f-8367-e3008e0e3072 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "GET /compute/v2.1/servers/bf8dbed9-b15d-4daf-af11-7ee001424482" status: 200 len: 1523 microversion: 2.1 time: 0.295256 Jul 12 13:29:55.876101 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 152/307] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:29:55 2022] GET /compute/v2.1/servers/bf8dbed9-b15d-4daf-af11-7ee001424482 => generated 1523 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:29:56.893245 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-12bae8ff-eec9-4894-9328-9ca3460f0074 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:29:56.893891 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-12bae8ff-eec9-4894-9328-9ca3460f0074 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: bf8dbed9-b15d-4daf-af11-7ee001424482] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:29:56.895767 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG dbcounter [-] [117988] Writing DB stats nova_api:SELECT=38 {{(pid=117988) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:29:56.902142 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-12bae8ff-eec9-4894-9328-9ca3460f0074 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:29:56.902697 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-12bae8ff-eec9-4894-9328-9ca3460f0074 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:29:56.903477 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-12bae8ff-eec9-4894-9328-9ca3460f0074 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:29:56.904043 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-12bae8ff-eec9-4894-9328-9ca3460f0074 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:29:57.049827 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-12bae8ff-eec9-4894-9328-9ca3460f0074 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f448776d1074e22bfe6cfbe05e01db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27fe465e6743e19feec424e6e9f3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:29:57.058074 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-12bae8ff-eec9-4894-9328-9ca3460f0074 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "GET /compute/v2.1/servers/bf8dbed9-b15d-4daf-af11-7ee001424482" status: 200 len: 1503 microversion: 2.1 time: 0.168706 Jul 12 13:29:57.058648 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 156/308] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:29:56 2022] GET /compute/v2.1/servers/bf8dbed9-b15d-4daf-af11-7ee001424482 => generated 1503 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:29:57.077953 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-3bed10b1-2907-44e1-aaa6-32b54aa7e93e tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d0ea84e9-b31c-4d9e-8b01-04107674c3bb"}} {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:29:57.079011 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-3bed10b1-2907-44e1-aaa6-32b54aa7e93e tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: bf8dbed9-b15d-4daf-af11-7ee001424482] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:29:57.087434 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-3bed10b1-2907-44e1-aaa6-32b54aa7e93e tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:29:57.087887 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-3bed10b1-2907-44e1-aaa6-32b54aa7e93e tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:29:57.088658 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-3bed10b1-2907-44e1-aaa6-32b54aa7e93e tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:29:57.089097 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-3bed10b1-2907-44e1-aaa6-32b54aa7e93e tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:29:57.113140 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.wsgi [None req-3bed10b1-2907-44e1-aaa6-32b54aa7e93e tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] HTTP exception thrown: Cannot 'attach_volume' instance bf8dbed9-b15d-4daf-af11-7ee001424482 while it is in vm_state rescued Jul 12 13:29:57.114881 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-3bed10b1-2907-44e1-aaa6-32b54aa7e93e tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Request method failure captured: Jul 12 13:29:57.114881 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: request: POST /compute/v2.1/servers/bf8dbed9-b15d-4daf-af11-7ee001424482/os-volume_attachments HTTP/1.1 Jul 12 13:29:57.114881 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: Accept: application/json Jul 12 13:29:57.114881 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: Accept-Encoding: identity Jul 12 13:29:57.114881 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: Connection: close Jul 12 13:29:57.114881 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: Content-Length: 74 Jul 12 13:29:57.114881 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: Content-Type: application/json Jul 12 13:29:57.114881 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: Host: 10.222.0.23 Jul 12 13:29:57.114881 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: Openstack-System-Scope: None Jul 12 13:29:57.114881 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: User-Agent: python-urllib3/1.26.9 Jul 12 13:29:57.114881 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Auth-Token: gAAAAABizXbHaqiAqZhWBI-vk_o7a-bGHsret_K3_OESrsSqXK-GPMz9bPJQcG7LrA86KpPc4AMrjwGTn_JiGdYdVtYddlqLRSDG3IHGj5eQPo9N843Dt2ruWjpHNFsSPymDgsCEgYLfMLp_zHvOn_zPoeXgUvrsNthFZ_9cbS3sn5NZOuhEk88 Jul 12 13:29:57.114881 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Domain-Id: None Jul 12 13:29:57.114881 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Domain-Name: None Jul 12 13:29:57.114881 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Identity-Status: Confirmed Jul 12 13:29:57.114881 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Is-Admin-Project: True Jul 12 13:29:57.114881 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Project-Domain-Id: default Jul 12 13:29:57.114881 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Project-Domain-Name: Default Jul 12 13:29:57.114881 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Project-Id: 2c27fe465e6743e19feec424e6e9f3d1 Jul 12 13:29:57.114881 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-115734551 Jul 12 13:29:57.114881 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Role: reader,member Jul 12 13:29:57.114881 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Roles: reader,member Jul 12 13:29:57.117428 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2c27fe465e6743e19feec424e6e9f3d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2c27fe465e6743e19feec424e6e9f3d1", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2c27fe465e6743e19feec424e6e9f3d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2c27fe465e6743e19feec424e6e9f3d1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] Jul 12 13:29:57.117428 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Tenant: tempest-ServerRescueNegativeTestJSON-115734551 Jul 12 13:29:57.117428 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Tenant-Id: 2c27fe465e6743e19feec424e6e9f3d1 Jul 12 13:29:57.117428 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-115734551 Jul 12 13:29:57.117428 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-User: tempest-ServerRescueNegativeTestJSON-115734551-project Jul 12 13:29:57.117428 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-User-Domain-Id: default Jul 12 13:29:57.117428 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-User-Domain-Name: Default Jul 12 13:29:57.117428 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-User-Id: 8f448776d1074e22bfe6cfbe05e01db7 Jul 12 13:29:57.117428 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-User-Name: tempest-ServerRescueNegativeTestJSON-115734551-project Jul 12 13:29:57.117428 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: Jul 12 13:29:57.117428 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: {"volumeAttachment": {"volumeId": "d0ea84e9-b31c-4d9e-8b01-04107674c3bb"}} Jul 12 13:29:57.117428 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: method: > Jul 12 13:29:57.118171 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: exception: Cannot 'attach_volume' instance bf8dbed9-b15d-4daf-af11-7ee001424482 while it is in vm_state rescued Jul 12 13:29:57.118171 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: action_args: {'server_id': 'bf8dbed9-b15d-4daf-af11-7ee001424482', 'body': {'volumeAttachment': {'volumeId': 'd0ea84e9-b31c-4d9e-8b01-04107674c3bb'}}} Jul 12 13:29:57.118171 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 13:29:57.118171 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:29:57.118171 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 12 13:29:57.118171 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 12 13:29:57.118171 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 12 13:29:57.118171 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 12 13:29:57.118171 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 12 13:29:57.118171 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 12 13:29:57.118171 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance bf8dbed9-b15d-4daf-af11-7ee001424482 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 12 13:29:57.118171 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi Jul 12 13:29:57.118171 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:29:57.118171 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi Jul 12 13:29:57.118171 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:29:57.118171 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:29:57.118171 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:29:57.118171 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 13:29:57.118171 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 13:29:57.122271 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 13:29:57.122271 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:29:57.122271 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 13:29:57.122271 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 13:29:57.122271 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 13:29:57.122271 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 13:29:57.122271 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 13:29:57.122271 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 13:29:57.122271 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 12 13:29:57.122271 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 12 13:29:57.122271 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 12 13:29:57.122271 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 12 13:29:57.122271 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance bf8dbed9-b15d-4daf-af11-7ee001424482 while it is in vm_state rescued Jul 12 13:29:57.122271 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi Jul 12 13:29:57.122271 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:29:57.122271 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi Jul 12 13:29:57.122271 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:29:57.122271 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:29:57.122271 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:29:57.123628 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 13:29:57.123628 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 13:29:57.123628 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance bf8dbed9-b15d-4daf-af11-7ee001424482 while it is in vm_state rescued Jul 12 13:29:57.123628 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi Jul 12 13:29:57.123628 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-3bed10b1-2907-44e1-aaa6-32b54aa7e93e tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Returning 409 to user: Cannot 'attach_volume' instance bf8dbed9-b15d-4daf-af11-7ee001424482 while it is in vm_state rescued {{(pid=117987) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 13:29:57.123628 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-3bed10b1-2907-44e1-aaa6-32b54aa7e93e tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "POST /compute/v2.1/servers/bf8dbed9-b15d-4daf-af11-7ee001424482/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.045074 Jul 12 13:29:57.123628 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 153/309] 10.222.0.23 () {60 vars in 1322 bytes} [Tue Jul 12 13:29:57 2022] POST /compute/v2.1/servers/bf8dbed9-b15d-4daf-af11-7ee001424482/os-volume_attachments => generated 152 bytes in 47 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jul 12 13:29:57.127225 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-34850373-e6d9-465b-b380-28ba4ddee487 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:29:57.127763 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-34850373-e6d9-465b-b380-28ba4ddee487 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: bf8dbed9-b15d-4daf-af11-7ee001424482] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:29:57.135257 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-34850373-e6d9-465b-b380-28ba4ddee487 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:29:57.135707 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-34850373-e6d9-465b-b380-28ba4ddee487 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:29:57.136472 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-34850373-e6d9-465b-b380-28ba4ddee487 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:29:57.136909 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-34850373-e6d9-465b-b380-28ba4ddee487 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:29:57.207428 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-34850373-e6d9-465b-b380-28ba4ddee487 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "POST /compute/v2.1/servers/bf8dbed9-b15d-4daf-af11-7ee001424482/action" status: 202 len: 0 microversion: 2.1 time: 0.083811 Jul 12 13:29:57.211828 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 157/310] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 12 13:29:57 2022] POST /compute/v2.1/servers/bf8dbed9-b15d-4daf-af11-7ee001424482/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 13:29:57.217088 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-17177a47-a3aa-43d6-8cd2-7848150f4b53 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:29:57.217698 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-17177a47-a3aa-43d6-8cd2-7848150f4b53 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: bf8dbed9-b15d-4daf-af11-7ee001424482] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:29:57.223853 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-17177a47-a3aa-43d6-8cd2-7848150f4b53 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:29:57.224304 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-17177a47-a3aa-43d6-8cd2-7848150f4b53 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:29:57.225717 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-17177a47-a3aa-43d6-8cd2-7848150f4b53 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:29:57.226464 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-17177a47-a3aa-43d6-8cd2-7848150f4b53 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:29:57.386081 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-17177a47-a3aa-43d6-8cd2-7848150f4b53 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f448776d1074e22bfe6cfbe05e01db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27fe465e6743e19feec424e6e9f3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:29:57.396120 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-17177a47-a3aa-43d6-8cd2-7848150f4b53 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "GET /compute/v2.1/servers/bf8dbed9-b15d-4daf-af11-7ee001424482" status: 200 len: 1511 microversion: 2.1 time: 0.182936 Jul 12 13:29:57.396968 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 154/311] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:29:57 2022] GET /compute/v2.1/servers/bf8dbed9-b15d-4daf-af11-7ee001424482 => generated 1511 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:29:58.415627 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-acae16c4-e57e-4e9f-ae14-c6c8f194790c tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:29:58.416334 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-acae16c4-e57e-4e9f-ae14-c6c8f194790c tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: bf8dbed9-b15d-4daf-af11-7ee001424482] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:29:58.423263 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-acae16c4-e57e-4e9f-ae14-c6c8f194790c tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:29:58.423717 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-acae16c4-e57e-4e9f-ae14-c6c8f194790c tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:29:58.424518 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-acae16c4-e57e-4e9f-ae14-c6c8f194790c tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:29:58.424951 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-acae16c4-e57e-4e9f-ae14-c6c8f194790c tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:29:58.559258 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-acae16c4-e57e-4e9f-ae14-c6c8f194790c tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f448776d1074e22bfe6cfbe05e01db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27fe465e6743e19feec424e6e9f3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:29:58.567686 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-acae16c4-e57e-4e9f-ae14-c6c8f194790c tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "GET /compute/v2.1/servers/bf8dbed9-b15d-4daf-af11-7ee001424482" status: 200 len: 1511 microversion: 2.1 time: 0.157072 Jul 12 13:29:58.568482 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 158/312] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:29:58 2022] GET /compute/v2.1/servers/bf8dbed9-b15d-4daf-af11-7ee001424482 => generated 1511 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:29:59.588146 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-e01e8e1a-77d1-4b8a-b6e6-801b05c79546 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:29:59.588912 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-e01e8e1a-77d1-4b8a-b6e6-801b05c79546 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: bf8dbed9-b15d-4daf-af11-7ee001424482] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:29:59.595980 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-e01e8e1a-77d1-4b8a-b6e6-801b05c79546 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:29:59.596423 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-e01e8e1a-77d1-4b8a-b6e6-801b05c79546 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:29:59.597187 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-e01e8e1a-77d1-4b8a-b6e6-801b05c79546 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:29:59.597651 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-e01e8e1a-77d1-4b8a-b6e6-801b05c79546 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:29:59.736604 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-e01e8e1a-77d1-4b8a-b6e6-801b05c79546 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f448776d1074e22bfe6cfbe05e01db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27fe465e6743e19feec424e6e9f3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:29:59.746082 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-e01e8e1a-77d1-4b8a-b6e6-801b05c79546 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "GET /compute/v2.1/servers/bf8dbed9-b15d-4daf-af11-7ee001424482" status: 200 len: 1511 microversion: 2.1 time: 0.163400 Jul 12 13:29:59.746776 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 155/313] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:29:59 2022] GET /compute/v2.1/servers/bf8dbed9-b15d-4daf-af11-7ee001424482 => generated 1511 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:30:00.763607 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-e059fa9b-4fdf-4ade-a008-fd4b7e60913d tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:30:00.764216 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-e059fa9b-4fdf-4ade-a008-fd4b7e60913d tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: bf8dbed9-b15d-4daf-af11-7ee001424482] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:30:00.770180 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-e059fa9b-4fdf-4ade-a008-fd4b7e60913d tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:30:00.770617 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-e059fa9b-4fdf-4ade-a008-fd4b7e60913d tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:30:00.771364 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-e059fa9b-4fdf-4ade-a008-fd4b7e60913d tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:30:00.771794 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-e059fa9b-4fdf-4ade-a008-fd4b7e60913d tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:30:00.914820 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-e059fa9b-4fdf-4ade-a008-fd4b7e60913d tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f448776d1074e22bfe6cfbe05e01db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27fe465e6743e19feec424e6e9f3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:30:00.922441 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-e059fa9b-4fdf-4ade-a008-fd4b7e60913d tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "GET /compute/v2.1/servers/bf8dbed9-b15d-4daf-af11-7ee001424482" status: 200 len: 1511 microversion: 2.1 time: 0.162673 Jul 12 13:30:00.923002 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 159/314] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:30:00 2022] GET /compute/v2.1/servers/bf8dbed9-b15d-4daf-af11-7ee001424482 => generated 1511 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:30:01.940414 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-bb400380-3d30-402c-b935-91c4b1468971 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:30:01.940992 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-bb400380-3d30-402c-b935-91c4b1468971 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: bf8dbed9-b15d-4daf-af11-7ee001424482] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:30:01.948631 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-bb400380-3d30-402c-b935-91c4b1468971 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:30:01.949076 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-bb400380-3d30-402c-b935-91c4b1468971 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:30:01.949874 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-bb400380-3d30-402c-b935-91c4b1468971 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:30:01.950333 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-bb400380-3d30-402c-b935-91c4b1468971 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:30:02.110871 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-bb400380-3d30-402c-b935-91c4b1468971 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f448776d1074e22bfe6cfbe05e01db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27fe465e6743e19feec424e6e9f3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:30:02.120017 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-bb400380-3d30-402c-b935-91c4b1468971 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "GET /compute/v2.1/servers/bf8dbed9-b15d-4daf-af11-7ee001424482" status: 200 len: 1511 microversion: 2.1 time: 0.183768 Jul 12 13:30:02.120601 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 156/315] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:30:01 2022] GET /compute/v2.1/servers/bf8dbed9-b15d-4daf-af11-7ee001424482 => generated 1511 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:30:03.138711 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-8774e408-9f05-4481-874f-11cf3ee0be04 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:30:03.139320 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-8774e408-9f05-4481-874f-11cf3ee0be04 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: bf8dbed9-b15d-4daf-af11-7ee001424482] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:30:03.145398 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-8774e408-9f05-4481-874f-11cf3ee0be04 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:30:03.145858 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-8774e408-9f05-4481-874f-11cf3ee0be04 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:30:03.146644 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-8774e408-9f05-4481-874f-11cf3ee0be04 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:30:03.147065 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-8774e408-9f05-4481-874f-11cf3ee0be04 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:30:03.299633 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-8774e408-9f05-4481-874f-11cf3ee0be04 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f448776d1074e22bfe6cfbe05e01db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27fe465e6743e19feec424e6e9f3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:30:03.308985 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-8774e408-9f05-4481-874f-11cf3ee0be04 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "GET /compute/v2.1/servers/bf8dbed9-b15d-4daf-af11-7ee001424482" status: 200 len: 1517 microversion: 2.1 time: 0.174165 Jul 12 13:30:03.309695 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 160/316] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:30:03 2022] GET /compute/v2.1/servers/bf8dbed9-b15d-4daf-af11-7ee001424482 => generated 1517 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:30:13.099529 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-f5504543-8569-4283-99b7-9ee55f930ac0 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Action: 'create', calling method: .version_select at 0x7f76e931ce50>, body: {"keypair": {"name": "tempest-keypair-1460597857", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDm6GImlt6T8eyrKT46QGX9hNCE3jtFcU8sx6Xxj3TDNtMhiPMd3j7bOMyQeUPRhvjbh8Iu+KcPfYobZLVH9gjuWR0cjeM1E5CgHYBIQ4/pFIMqb6kF7gj68iRys3aX/fA=="}} {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:30:13.104179 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG dbcounter [-] [117987] Writing DB stats nova_api:SELECT=9 {{(pid=117987) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:30:13.104857 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG dbcounter [-] [117987] Writing DB stats nova_cell1:SELECT=22 {{(pid=117987) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:30:13.117403 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.quota [None req-f5504543-8569-4283-99b7-9ee55f930ac0 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Getting quotas for project 2c27fe465e6743e19feec424e6e9f3d1. Resources: {'key_pairs'} {{(pid=117987) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 13:30:13.121460 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.quota [None req-f5504543-8569-4283-99b7-9ee55f930ac0 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Getting quotas for user 8f448776d1074e22bfe6cfbe05e01db7 and project 2c27fe465e6743e19feec424e6e9f3d1. Resources: {'key_pairs'} {{(pid=117987) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 13:30:13.155447 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-f5504543-8569-4283-99b7-9ee55f930ac0 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.059742 Jul 12 13:30:13.156106 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 157/317] 10.222.0.23 () {60 vars in 1158 bytes} [Tue Jul 12 13:30:13 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:30:13.672235 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-15e64367-011c-4e17-9c89-5286bdeb902c tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "44bc672f-8024-4c91-ac9f-3a5b29d95cf6", "device": "/dev/sdb"}} {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:30:13.673888 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-15e64367-011c-4e17-9c89-5286bdeb902c tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] [instance: e64254d9-b532-4900-ae02-13cf7c68b1d7] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:30:13.676166 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG dbcounter [-] [117988] Writing DB stats nova_api:SELECT=9 {{(pid=117988) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:30:13.676829 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG dbcounter [-] [117988] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117988) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:30:13.683778 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-15e64367-011c-4e17-9c89-5286bdeb902c tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:30:13.684224 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-15e64367-011c-4e17-9c89-5286bdeb902c tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:30:13.685008 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-15e64367-011c-4e17-9c89-5286bdeb902c tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:30:13.685465 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-15e64367-011c-4e17-9c89-5286bdeb902c tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:30:14.018522 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-15e64367-011c-4e17-9c89-5286bdeb902c tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] 10.222.0.23 "POST /compute/v2.1/servers/e64254d9-b532-4900-ae02-13cf7c68b1d7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.349901 Jul 12 13:30:14.019212 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 161/318] 10.222.0.23 () {60 vars in 1322 bytes} [Tue Jul 12 13:30:13 2022] POST /compute/v2.1/servers/e64254d9-b532-4900-ae02-13cf7c68b1d7/os-volume_attachments => generated 194 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:30:14.610281 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-22d652aa-0b37-4561-846c-06ffa466ad42 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1272736640", "imageRef": "ce5a4b61-4265-43de-a33e-a23a4c9f612d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b989f9ce-12b7-439b-b182-1338e89fb49f"}], "security_groups": [{"name": "tempest-securitygroup--1918658000"}], "key_name": "tempest-keypair-1460597857", "user_data": "}} {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:30:14.716274 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.network.neutron [None req-22d652aa-0b37-4561-846c-06ffa466ad42 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] validate_networks() for [('b989f9ce-12b7-439b-b182-1338e89fb49f', None, None, None, None, None)] {{(pid=117987) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 13:30:15.108845 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.virt.hardware [None req-22d652aa-0b37-4561-846c-06ffa466ad42 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Flavor limits 0:0:0 {{(pid=117987) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 13:30:15.109265 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.virt.hardware [None req-22d652aa-0b37-4561-846c-06ffa466ad42 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Image limits 0:0:0 {{(pid=117987) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 13:30:15.109955 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.virt.hardware [None req-22d652aa-0b37-4561-846c-06ffa466ad42 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Flavor pref 0:0:0 {{(pid=117987) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 13:30:15.110364 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.virt.hardware [None req-22d652aa-0b37-4561-846c-06ffa466ad42 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Image pref 0:0:0 {{(pid=117987) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 13:30:15.110804 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.virt.hardware [None req-22d652aa-0b37-4561-846c-06ffa466ad42 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117987) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 13:30:15.120140 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-22d652aa-0b37-4561-846c-06ffa466ad42 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:30:15.120710 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-22d652aa-0b37-4561-846c-06ffa466ad42 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:30:15.121548 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-22d652aa-0b37-4561-846c-06ffa466ad42 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:30:15.121984 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-22d652aa-0b37-4561-846c-06ffa466ad42 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:30:15.142147 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.quota [None req-22d652aa-0b37-4561-846c-06ffa466ad42 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Getting quotas for project 2c27fe465e6743e19feec424e6e9f3d1. Resources: {'ram', 'cores', 'instances'} {{(pid=117987) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 13:30:15.146216 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.quota [None req-22d652aa-0b37-4561-846c-06ffa466ad42 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Getting quotas for user 8f448776d1074e22bfe6cfbe05e01db7 and project 2c27fe465e6743e19feec424e6e9f3d1. Resources: {'ram', 'cores', 'instances'} {{(pid=117987) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 13:30:15.158903 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-22d652aa-0b37-4561-846c-06ffa466ad42 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Going to run 1 instances... {{(pid=117987) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 13:30:15.161147 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-22d652aa-0b37-4561-846c-06ffa466ad42 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: 5982cf25-982e-4787-8992-63184a0dd50f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ce5a4b61-4265-43de-a33e-a23a4c9f612d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117987) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 13:30:15.209517 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-22d652aa-0b37-4561-846c-06ffa466ad42 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.603971 Jul 12 13:30:15.210154 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 158/319] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 12 13:30:14 2022] POST /compute/v2.1/servers => generated 409 bytes in 605 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 13:30:15.233730 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-e24b5373-80cc-448e-bc07-f8c14a7622f7 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:30:15.234439 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-e24b5373-80cc-448e-bc07-f8c14a7622f7 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: 5982cf25-982e-4787-8992-63184a0dd50f] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:30:15.299036 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-e24b5373-80cc-448e-bc07-f8c14a7622f7 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f448776d1074e22bfe6cfbe05e01db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27fe465e6743e19feec424e6e9f3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:30:15.306134 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-e24b5373-80cc-448e-bc07-f8c14a7622f7 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "GET /compute/v2.1/servers/5982cf25-982e-4787-8992-63184a0dd50f" status: 200 len: 1246 microversion: 2.1 time: 0.089150 Jul 12 13:30:15.306972 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 162/320] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:30:15 2022] GET /compute/v2.1/servers/5982cf25-982e-4787-8992-63184a0dd50f => generated 1246 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:30:16.325109 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-bd895608-e197-4936-be84-513a8bf31dde tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:30:16.326286 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-bd895608-e197-4936-be84-513a8bf31dde tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: 5982cf25-982e-4787-8992-63184a0dd50f] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:30:16.333749 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-bd895608-e197-4936-be84-513a8bf31dde tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:30:16.334420 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-bd895608-e197-4936-be84-513a8bf31dde tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:30:16.335378 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-bd895608-e197-4936-be84-513a8bf31dde tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:30:16.335980 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-bd895608-e197-4936-be84-513a8bf31dde tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:30:16.437751 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-bd895608-e197-4936-be84-513a8bf31dde tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f448776d1074e22bfe6cfbe05e01db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27fe465e6743e19feec424e6e9f3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:30:16.449289 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-bd895608-e197-4936-be84-513a8bf31dde tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "GET /compute/v2.1/servers/5982cf25-982e-4787-8992-63184a0dd50f" status: 200 len: 1306 microversion: 2.1 time: 0.128982 Jul 12 13:30:16.450610 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 159/321] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:30:16 2022] GET /compute/v2.1/servers/5982cf25-982e-4787-8992-63184a0dd50f => generated 1306 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:30:17.467225 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-209f8bed-3c31-425b-ac60-4cab9b272e88 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:30:17.468082 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-209f8bed-3c31-425b-ac60-4cab9b272e88 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: 5982cf25-982e-4787-8992-63184a0dd50f] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:30:17.475754 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-209f8bed-3c31-425b-ac60-4cab9b272e88 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:30:17.476185 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-209f8bed-3c31-425b-ac60-4cab9b272e88 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:30:17.477116 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-209f8bed-3c31-425b-ac60-4cab9b272e88 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:30:17.477605 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-209f8bed-3c31-425b-ac60-4cab9b272e88 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:30:17.699293 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-209f8bed-3c31-425b-ac60-4cab9b272e88 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f448776d1074e22bfe6cfbe05e01db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27fe465e6743e19feec424e6e9f3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:30:17.707066 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-209f8bed-3c31-425b-ac60-4cab9b272e88 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "GET /compute/v2.1/servers/5982cf25-982e-4787-8992-63184a0dd50f" status: 200 len: 1372 microversion: 2.1 time: 0.244064 Jul 12 13:30:17.707848 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 163/322] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:30:17 2022] GET /compute/v2.1/servers/5982cf25-982e-4787-8992-63184a0dd50f => generated 1372 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:30:18.351434 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [req-0b3eec9f-6027-4120-bec0-9f065c6f5a50 req-5ca2c88d-41e0-4e77-806b-1acac54e72c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5982cf25-982e-4787-8992-63184a0dd50f", "tag": "48ee5689-784c-4392-88f9-2238b2c24ca3"}]} {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:30:18.378017 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [req-0b3eec9f-6027-4120-bec0-9f065c6f5a50 req-5ca2c88d-41e0-4e77-806b-1acac54e72c0 service nova] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:30:18.378522 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [req-0b3eec9f-6027-4120-bec0-9f065c6f5a50 req-5ca2c88d-41e0-4e77-806b-1acac54e72c0 service nova] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:30:18.391046 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.compute.server_external_events [req-0b3eec9f-6027-4120-bec0-9f065c6f5a50 req-5ca2c88d-41e0-4e77-806b-1acac54e72c0 service nova] Creating event network-changed:48ee5689-784c-4392-88f9-2238b2c24ca3 for instance 5982cf25-982e-4787-8992-63184a0dd50f on hv-cinder-82002 Jul 12 13:30:18.396420 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [req-0b3eec9f-6027-4120-bec0-9f065c6f5a50 req-5ca2c88d-41e0-4e77-806b-1acac54e72c0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062285 Jul 12 13:30:18.397096 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 160/323] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 12 13:30:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:30:18.724041 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-08eeef2d-f0c4-4b06-8d66-775f169f1cab tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:30:18.724892 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-08eeef2d-f0c4-4b06-8d66-775f169f1cab tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: 5982cf25-982e-4787-8992-63184a0dd50f] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:30:18.732229 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-08eeef2d-f0c4-4b06-8d66-775f169f1cab tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:30:18.732675 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-08eeef2d-f0c4-4b06-8d66-775f169f1cab tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:30:18.733464 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-08eeef2d-f0c4-4b06-8d66-775f169f1cab tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:30:18.734114 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-08eeef2d-f0c4-4b06-8d66-775f169f1cab tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:30:19.027990 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-08eeef2d-f0c4-4b06-8d66-775f169f1cab tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f448776d1074e22bfe6cfbe05e01db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27fe465e6743e19feec424e6e9f3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:30:19.038200 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-08eeef2d-f0c4-4b06-8d66-775f169f1cab tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "GET /compute/v2.1/servers/5982cf25-982e-4787-8992-63184a0dd50f" status: 200 len: 1372 microversion: 2.1 time: 0.317901 Jul 12 13:30:19.038851 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 164/324] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:30:18 2022] GET /compute/v2.1/servers/5982cf25-982e-4787-8992-63184a0dd50f => generated 1372 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:30:20.057150 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-73462643-1cdd-4c02-8956-b6a9b6b1d5ca tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:30:20.058598 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-73462643-1cdd-4c02-8956-b6a9b6b1d5ca tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: 5982cf25-982e-4787-8992-63184a0dd50f] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:30:20.065485 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-73462643-1cdd-4c02-8956-b6a9b6b1d5ca tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:30:20.065938 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-73462643-1cdd-4c02-8956-b6a9b6b1d5ca tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:30:20.066712 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-73462643-1cdd-4c02-8956-b6a9b6b1d5ca tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:30:20.067149 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-73462643-1cdd-4c02-8956-b6a9b6b1d5ca tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:30:20.204983 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-73462643-1cdd-4c02-8956-b6a9b6b1d5ca tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f448776d1074e22bfe6cfbe05e01db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27fe465e6743e19feec424e6e9f3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:30:20.212774 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-73462643-1cdd-4c02-8956-b6a9b6b1d5ca tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "GET /compute/v2.1/servers/5982cf25-982e-4787-8992-63184a0dd50f" status: 200 len: 1372 microversion: 2.1 time: 0.160453 Jul 12 13:30:20.213337 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 161/325] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:30:20 2022] GET /compute/v2.1/servers/5982cf25-982e-4787-8992-63184a0dd50f => generated 1372 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:30:21.230502 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-1e1f5e54-319c-4f61-94e4-c7e78ff7b14c tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:30:21.230993 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-1e1f5e54-319c-4f61-94e4-c7e78ff7b14c tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: 5982cf25-982e-4787-8992-63184a0dd50f] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:30:21.237538 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-1e1f5e54-319c-4f61-94e4-c7e78ff7b14c tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:30:21.237989 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-1e1f5e54-319c-4f61-94e4-c7e78ff7b14c tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:30:21.238761 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-1e1f5e54-319c-4f61-94e4-c7e78ff7b14c tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:30:21.239195 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-1e1f5e54-319c-4f61-94e4-c7e78ff7b14c tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:30:21.382694 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-1e1f5e54-319c-4f61-94e4-c7e78ff7b14c tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f448776d1074e22bfe6cfbe05e01db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27fe465e6743e19feec424e6e9f3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:30:21.390970 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-1e1f5e54-319c-4f61-94e4-c7e78ff7b14c tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "GET /compute/v2.1/servers/5982cf25-982e-4787-8992-63184a0dd50f" status: 200 len: 1372 microversion: 2.1 time: 0.165565 Jul 12 13:30:21.391539 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 165/326] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:30:21 2022] GET /compute/v2.1/servers/5982cf25-982e-4787-8992-63184a0dd50f => generated 1372 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:30:22.408567 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-dce6d1db-40c7-4455-b7c5-450487f53cb1 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:30:22.409305 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-dce6d1db-40c7-4455-b7c5-450487f53cb1 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: 5982cf25-982e-4787-8992-63184a0dd50f] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:30:22.417692 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-dce6d1db-40c7-4455-b7c5-450487f53cb1 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:30:22.418617 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-dce6d1db-40c7-4455-b7c5-450487f53cb1 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:30:22.419932 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-dce6d1db-40c7-4455-b7c5-450487f53cb1 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:30:22.421039 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-dce6d1db-40c7-4455-b7c5-450487f53cb1 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:30:22.564268 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-dce6d1db-40c7-4455-b7c5-450487f53cb1 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f448776d1074e22bfe6cfbe05e01db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27fe465e6743e19feec424e6e9f3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:30:22.571507 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-dce6d1db-40c7-4455-b7c5-450487f53cb1 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "GET /compute/v2.1/servers/5982cf25-982e-4787-8992-63184a0dd50f" status: 200 len: 1372 microversion: 2.1 time: 0.166782 Jul 12 13:30:22.572271 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 162/327] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:30:22 2022] GET /compute/v2.1/servers/5982cf25-982e-4787-8992-63184a0dd50f => generated 1372 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:30:23.589325 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-c29beb1e-49d2-44f0-be2d-964c17142df2 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:30:23.590546 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-c29beb1e-49d2-44f0-be2d-964c17142df2 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: 5982cf25-982e-4787-8992-63184a0dd50f] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:30:23.597295 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-c29beb1e-49d2-44f0-be2d-964c17142df2 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:30:23.598116 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-c29beb1e-49d2-44f0-be2d-964c17142df2 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:30:23.598897 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-c29beb1e-49d2-44f0-be2d-964c17142df2 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:30:23.599624 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-c29beb1e-49d2-44f0-be2d-964c17142df2 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:30:23.818551 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-c29beb1e-49d2-44f0-be2d-964c17142df2 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f448776d1074e22bfe6cfbe05e01db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27fe465e6743e19feec424e6e9f3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:30:23.833437 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-c29beb1e-49d2-44f0-be2d-964c17142df2 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "GET /compute/v2.1/servers/5982cf25-982e-4787-8992-63184a0dd50f" status: 200 len: 1372 microversion: 2.1 time: 0.247768 Jul 12 13:30:23.834342 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 166/328] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:30:23 2022] GET /compute/v2.1/servers/5982cf25-982e-4787-8992-63184a0dd50f => generated 1372 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:30:24.861124 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-d304db69-f29c-41e6-a912-53f7858db631 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:30:24.862538 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-d304db69-f29c-41e6-a912-53f7858db631 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: 5982cf25-982e-4787-8992-63184a0dd50f] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:30:24.869110 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-d304db69-f29c-41e6-a912-53f7858db631 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:30:24.869603 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-d304db69-f29c-41e6-a912-53f7858db631 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:30:24.870374 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-d304db69-f29c-41e6-a912-53f7858db631 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:30:24.870813 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-d304db69-f29c-41e6-a912-53f7858db631 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:30:25.020025 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-d304db69-f29c-41e6-a912-53f7858db631 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f448776d1074e22bfe6cfbe05e01db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27fe465e6743e19feec424e6e9f3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:30:25.027565 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-d304db69-f29c-41e6-a912-53f7858db631 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "GET /compute/v2.1/servers/5982cf25-982e-4787-8992-63184a0dd50f" status: 200 len: 1372 microversion: 2.1 time: 0.177020 Jul 12 13:30:25.028532 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 163/329] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:30:24 2022] GET /compute/v2.1/servers/5982cf25-982e-4787-8992-63184a0dd50f => generated 1372 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:30:26.006229 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [req-560d9c7b-8f1f-43a0-a730-b6d9c9d38a0d req-6e33e238-6e5c-4323-bb61-12e716ed31b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5982cf25-982e-4787-8992-63184a0dd50f", "name": "network-vif-plugged", "status": "completed", "tag": "48ee5689-784c-4392-88f9-2238b2c24ca3"}]} {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:30:26.010724 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG dbcounter [-] [117988] Writing DB stats nova_cell0:SELECT=2 {{(pid=117988) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:30:26.018117 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [req-560d9c7b-8f1f-43a0-a730-b6d9c9d38a0d req-6e33e238-6e5c-4323-bb61-12e716ed31b1 service nova] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:30:26.018590 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [req-560d9c7b-8f1f-43a0-a730-b6d9c9d38a0d req-6e33e238-6e5c-4323-bb61-12e716ed31b1 service nova] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:30:26.029964 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.compute.server_external_events [req-560d9c7b-8f1f-43a0-a730-b6d9c9d38a0d req-6e33e238-6e5c-4323-bb61-12e716ed31b1 service nova] Creating event network-vif-plugged:48ee5689-784c-4392-88f9-2238b2c24ca3 for instance 5982cf25-982e-4787-8992-63184a0dd50f on hv-cinder-82002 Jul 12 13:30:26.035197 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [req-560d9c7b-8f1f-43a0-a730-b6d9c9d38a0d req-6e33e238-6e5c-4323-bb61-12e716ed31b1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032597 Jul 12 13:30:26.035799 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 167/330] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 12 13:30:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:30:26.044124 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-a1fa5871-3688-46c3-9c82-12532e7d81f7 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:30:26.044841 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-a1fa5871-3688-46c3-9c82-12532e7d81f7 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: 5982cf25-982e-4787-8992-63184a0dd50f] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:30:26.047067 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG dbcounter [-] [117987] Writing DB stats nova_cell0:SELECT=2 {{(pid=117987) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:30:26.047801 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG dbcounter [-] [117987] Writing DB stats nova_cell0:SELECT=10 {{(pid=117987) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:30:26.055344 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-a1fa5871-3688-46c3-9c82-12532e7d81f7 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:30:26.055944 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-a1fa5871-3688-46c3-9c82-12532e7d81f7 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:30:26.056778 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-a1fa5871-3688-46c3-9c82-12532e7d81f7 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:30:26.057235 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-a1fa5871-3688-46c3-9c82-12532e7d81f7 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:30:26.192796 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-a1fa5871-3688-46c3-9c82-12532e7d81f7 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f448776d1074e22bfe6cfbe05e01db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27fe465e6743e19feec424e6e9f3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:30:26.200359 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-a1fa5871-3688-46c3-9c82-12532e7d81f7 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "GET /compute/v2.1/servers/5982cf25-982e-4787-8992-63184a0dd50f" status: 200 len: 1372 microversion: 2.1 time: 0.160129 Jul 12 13:30:26.200906 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 164/331] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:30:26 2022] GET /compute/v2.1/servers/5982cf25-982e-4787-8992-63184a0dd50f => generated 1372 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:30:27.218234 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-5425a611-df8a-43a9-a004-19bebf0caf4a tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:30:27.218931 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-5425a611-df8a-43a9-a004-19bebf0caf4a tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: 5982cf25-982e-4787-8992-63184a0dd50f] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:30:27.225164 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-5425a611-df8a-43a9-a004-19bebf0caf4a tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:30:27.225643 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-5425a611-df8a-43a9-a004-19bebf0caf4a tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:30:27.226418 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-5425a611-df8a-43a9-a004-19bebf0caf4a tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:30:27.226853 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-5425a611-df8a-43a9-a004-19bebf0caf4a tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:30:27.361190 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-5425a611-df8a-43a9-a004-19bebf0caf4a tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f448776d1074e22bfe6cfbe05e01db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27fe465e6743e19feec424e6e9f3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:30:27.368584 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-5425a611-df8a-43a9-a004-19bebf0caf4a tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "GET /compute/v2.1/servers/5982cf25-982e-4787-8992-63184a0dd50f" status: 200 len: 1372 microversion: 2.1 time: 0.155504 Jul 12 13:30:27.369143 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 168/332] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:30:27 2022] GET /compute/v2.1/servers/5982cf25-982e-4787-8992-63184a0dd50f => generated 1372 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:30:28.388766 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-f391f7b5-4592-4bb7-a792-654913612110 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:30:28.389481 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-f391f7b5-4592-4bb7-a792-654913612110 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: 5982cf25-982e-4787-8992-63184a0dd50f] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:30:28.395939 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-f391f7b5-4592-4bb7-a792-654913612110 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:30:28.396384 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-f391f7b5-4592-4bb7-a792-654913612110 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:30:28.397156 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-f391f7b5-4592-4bb7-a792-654913612110 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:30:28.397616 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-f391f7b5-4592-4bb7-a792-654913612110 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:30:28.541717 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-f391f7b5-4592-4bb7-a792-654913612110 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f448776d1074e22bfe6cfbe05e01db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27fe465e6743e19feec424e6e9f3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:30:28.549770 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-f391f7b5-4592-4bb7-a792-654913612110 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "GET /compute/v2.1/servers/5982cf25-982e-4787-8992-63184a0dd50f" status: 200 len: 1372 microversion: 2.1 time: 0.165287 Jul 12 13:30:28.550339 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 165/333] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:30:28 2022] GET /compute/v2.1/servers/5982cf25-982e-4787-8992-63184a0dd50f => generated 1372 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:30:29.567870 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-fb7f8b57-2b42-4a80-87fd-c6c71202c789 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:30:29.568408 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-fb7f8b57-2b42-4a80-87fd-c6c71202c789 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: 5982cf25-982e-4787-8992-63184a0dd50f] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:30:29.576468 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-fb7f8b57-2b42-4a80-87fd-c6c71202c789 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:30:29.577088 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-fb7f8b57-2b42-4a80-87fd-c6c71202c789 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:30:29.577908 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-fb7f8b57-2b42-4a80-87fd-c6c71202c789 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:30:29.578347 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-fb7f8b57-2b42-4a80-87fd-c6c71202c789 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:30:29.728100 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-fb7f8b57-2b42-4a80-87fd-c6c71202c789 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f448776d1074e22bfe6cfbe05e01db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27fe465e6743e19feec424e6e9f3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:30:29.736267 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-fb7f8b57-2b42-4a80-87fd-c6c71202c789 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "GET /compute/v2.1/servers/5982cf25-982e-4787-8992-63184a0dd50f" status: 200 len: 1372 microversion: 2.1 time: 0.172582 Jul 12 13:30:29.736858 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 169/334] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:30:29 2022] GET /compute/v2.1/servers/5982cf25-982e-4787-8992-63184a0dd50f => generated 1372 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:30:30.753124 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-31beaeff-852d-4ad6-b60f-5f085b665f7f tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:30:30.753765 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-31beaeff-852d-4ad6-b60f-5f085b665f7f tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: 5982cf25-982e-4787-8992-63184a0dd50f] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:30:30.760261 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-31beaeff-852d-4ad6-b60f-5f085b665f7f tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:30:30.760710 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-31beaeff-852d-4ad6-b60f-5f085b665f7f tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:30:30.761505 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-31beaeff-852d-4ad6-b60f-5f085b665f7f tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:30:30.762554 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-31beaeff-852d-4ad6-b60f-5f085b665f7f tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:30:30.899267 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-31beaeff-852d-4ad6-b60f-5f085b665f7f tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f448776d1074e22bfe6cfbe05e01db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27fe465e6743e19feec424e6e9f3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:30:30.907474 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-31beaeff-852d-4ad6-b60f-5f085b665f7f tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "GET /compute/v2.1/servers/5982cf25-982e-4787-8992-63184a0dd50f" status: 200 len: 1372 microversion: 2.1 time: 0.158223 Jul 12 13:30:30.908053 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 166/335] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:30:30 2022] GET /compute/v2.1/servers/5982cf25-982e-4787-8992-63184a0dd50f => generated 1372 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:30:31.925223 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-ff843417-4232-4bcd-8f17-fb83ec3bec32 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:30:31.925863 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-ff843417-4232-4bcd-8f17-fb83ec3bec32 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: 5982cf25-982e-4787-8992-63184a0dd50f] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:30:31.932413 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-ff843417-4232-4bcd-8f17-fb83ec3bec32 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:30:31.932871 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-ff843417-4232-4bcd-8f17-fb83ec3bec32 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:30:31.933787 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-ff843417-4232-4bcd-8f17-fb83ec3bec32 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:30:31.934442 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-ff843417-4232-4bcd-8f17-fb83ec3bec32 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:30:32.081938 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-ff843417-4232-4bcd-8f17-fb83ec3bec32 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f448776d1074e22bfe6cfbe05e01db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27fe465e6743e19feec424e6e9f3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:30:32.089369 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-ff843417-4232-4bcd-8f17-fb83ec3bec32 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "GET /compute/v2.1/servers/5982cf25-982e-4787-8992-63184a0dd50f" status: 200 len: 1372 microversion: 2.1 time: 0.167984 Jul 12 13:30:32.089985 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 170/336] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:30:31 2022] GET /compute/v2.1/servers/5982cf25-982e-4787-8992-63184a0dd50f => generated 1372 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:30:33.107473 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-fb011a72-1492-479b-b51c-0792c0ce6fc9 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:30:33.108130 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-fb011a72-1492-479b-b51c-0792c0ce6fc9 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: 5982cf25-982e-4787-8992-63184a0dd50f] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:30:33.114958 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-fb011a72-1492-479b-b51c-0792c0ce6fc9 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:30:33.115409 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-fb011a72-1492-479b-b51c-0792c0ce6fc9 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:30:33.116189 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-fb011a72-1492-479b-b51c-0792c0ce6fc9 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:30:33.116625 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-fb011a72-1492-479b-b51c-0792c0ce6fc9 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:30:33.269521 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-fb011a72-1492-479b-b51c-0792c0ce6fc9 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f448776d1074e22bfe6cfbe05e01db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27fe465e6743e19feec424e6e9f3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:30:33.276945 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-fb011a72-1492-479b-b51c-0792c0ce6fc9 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "GET /compute/v2.1/servers/5982cf25-982e-4787-8992-63184a0dd50f" status: 200 len: 1372 microversion: 2.1 time: 0.174330 Jul 12 13:30:33.278192 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 167/337] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:30:33 2022] GET /compute/v2.1/servers/5982cf25-982e-4787-8992-63184a0dd50f => generated 1372 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:30:34.294427 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-1e385c70-203d-4bdf-9693-277dbe5d84f1 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:30:34.295046 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-1e385c70-203d-4bdf-9693-277dbe5d84f1 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: 5982cf25-982e-4787-8992-63184a0dd50f] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:30:34.301605 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-1e385c70-203d-4bdf-9693-277dbe5d84f1 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:30:34.302058 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-1e385c70-203d-4bdf-9693-277dbe5d84f1 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:30:34.302837 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-1e385c70-203d-4bdf-9693-277dbe5d84f1 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:30:34.303276 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-1e385c70-203d-4bdf-9693-277dbe5d84f1 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:30:34.433622 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-1e385c70-203d-4bdf-9693-277dbe5d84f1 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f448776d1074e22bfe6cfbe05e01db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27fe465e6743e19feec424e6e9f3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:30:34.441578 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-1e385c70-203d-4bdf-9693-277dbe5d84f1 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "GET /compute/v2.1/servers/5982cf25-982e-4787-8992-63184a0dd50f" status: 200 len: 1372 microversion: 2.1 time: 0.151134 Jul 12 13:30:34.442140 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 171/338] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:30:34 2022] GET /compute/v2.1/servers/5982cf25-982e-4787-8992-63184a0dd50f => generated 1372 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:30:35.459101 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-e8612529-bb9b-4b2c-9270-c5cfdb6f0a6e tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:30:35.459742 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-e8612529-bb9b-4b2c-9270-c5cfdb6f0a6e tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: 5982cf25-982e-4787-8992-63184a0dd50f] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:30:35.467961 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-e8612529-bb9b-4b2c-9270-c5cfdb6f0a6e tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:30:35.468451 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-e8612529-bb9b-4b2c-9270-c5cfdb6f0a6e tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:30:35.469811 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-e8612529-bb9b-4b2c-9270-c5cfdb6f0a6e tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:30:35.470546 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-e8612529-bb9b-4b2c-9270-c5cfdb6f0a6e tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:30:35.612915 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-e8612529-bb9b-4b2c-9270-c5cfdb6f0a6e tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f448776d1074e22bfe6cfbe05e01db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27fe465e6743e19feec424e6e9f3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:30:35.620499 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-e8612529-bb9b-4b2c-9270-c5cfdb6f0a6e tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "GET /compute/v2.1/servers/5982cf25-982e-4787-8992-63184a0dd50f" status: 200 len: 1372 microversion: 2.1 time: 0.165312 Jul 12 13:30:35.621702 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 168/339] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:30:35 2022] GET /compute/v2.1/servers/5982cf25-982e-4787-8992-63184a0dd50f => generated 1372 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:30:36.639013 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-6d74be81-2604-44b4-a71d-387972099aec tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:30:36.639625 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-6d74be81-2604-44b4-a71d-387972099aec tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: 5982cf25-982e-4787-8992-63184a0dd50f] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:30:36.646471 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-6d74be81-2604-44b4-a71d-387972099aec tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:30:36.646925 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-6d74be81-2604-44b4-a71d-387972099aec tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:30:36.647802 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-6d74be81-2604-44b4-a71d-387972099aec tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:30:36.648127 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-6d74be81-2604-44b4-a71d-387972099aec tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:30:36.785632 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-6d74be81-2604-44b4-a71d-387972099aec tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f448776d1074e22bfe6cfbe05e01db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27fe465e6743e19feec424e6e9f3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:30:36.793956 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-6d74be81-2604-44b4-a71d-387972099aec tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "GET /compute/v2.1/servers/5982cf25-982e-4787-8992-63184a0dd50f" status: 200 len: 1372 microversion: 2.1 time: 0.159842 Jul 12 13:30:36.794789 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 172/340] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:30:36 2022] GET /compute/v2.1/servers/5982cf25-982e-4787-8992-63184a0dd50f => generated 1372 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:30:37.811756 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-cb9a1f9c-7bb6-4918-b386-68d9c7b17141 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:30:37.812303 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-cb9a1f9c-7bb6-4918-b386-68d9c7b17141 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: 5982cf25-982e-4787-8992-63184a0dd50f] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:30:37.819169 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-cb9a1f9c-7bb6-4918-b386-68d9c7b17141 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:30:37.819610 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-cb9a1f9c-7bb6-4918-b386-68d9c7b17141 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:30:37.820375 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-cb9a1f9c-7bb6-4918-b386-68d9c7b17141 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:30:37.820811 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-cb9a1f9c-7bb6-4918-b386-68d9c7b17141 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:30:37.963950 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-cb9a1f9c-7bb6-4918-b386-68d9c7b17141 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f448776d1074e22bfe6cfbe05e01db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27fe465e6743e19feec424e6e9f3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:30:37.972799 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-cb9a1f9c-7bb6-4918-b386-68d9c7b17141 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "GET /compute/v2.1/servers/5982cf25-982e-4787-8992-63184a0dd50f" status: 200 len: 1566 microversion: 2.1 time: 0.165677 Jul 12 13:30:37.973368 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 169/341] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:30:37 2022] GET /compute/v2.1/servers/5982cf25-982e-4787-8992-63184a0dd50f => generated 1566 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:30:37.990191 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-0a61d5c5-6eef-4c4c-9226-9b18116479ee tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:30:37.990751 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-0a61d5c5-6eef-4c4c-9226-9b18116479ee tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: 5982cf25-982e-4787-8992-63184a0dd50f] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:30:37.998974 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-0a61d5c5-6eef-4c4c-9226-9b18116479ee tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:30:37.999444 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-0a61d5c5-6eef-4c4c-9226-9b18116479ee tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:30:38.000213 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-0a61d5c5-6eef-4c4c-9226-9b18116479ee tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:30:38.000636 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-0a61d5c5-6eef-4c4c-9226-9b18116479ee tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:30:38.087266 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-0a61d5c5-6eef-4c4c-9226-9b18116479ee tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "GET /compute/v2.1/servers/5982cf25-982e-4787-8992-63184a0dd50f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.101522 Jul 12 13:30:38.087858 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 173/342] 10.222.0.23 () {58 vars in 1274 bytes} [Tue Jul 12 13:30:37 2022] GET /compute/v2.1/servers/5982cf25-982e-4787-8992-63184a0dd50f/os-interface => generated 284 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:30:39.263783 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [req-8da41f62-3342-4084-81c6-4910f559974b req-ec734020-224a-47d6-ba19-2b680109f960 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5982cf25-982e-4787-8992-63184a0dd50f", "tag": "48ee5689-784c-4392-88f9-2238b2c24ca3"}]} {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:30:39.272325 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [req-8da41f62-3342-4084-81c6-4910f559974b req-ec734020-224a-47d6-ba19-2b680109f960 service nova] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:30:39.272768 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [req-8da41f62-3342-4084-81c6-4910f559974b req-ec734020-224a-47d6-ba19-2b680109f960 service nova] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:30:39.284618 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.compute.server_external_events [req-8da41f62-3342-4084-81c6-4910f559974b req-ec734020-224a-47d6-ba19-2b680109f960 service nova] Creating event network-changed:48ee5689-784c-4392-88f9-2238b2c24ca3 for instance 5982cf25-982e-4787-8992-63184a0dd50f on hv-cinder-82002 Jul 12 13:30:39.289741 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [req-8da41f62-3342-4084-81c6-4910f559974b req-ec734020-224a-47d6-ba19-2b680109f960 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030200 Jul 12 13:30:39.290348 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 170/343] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 12 13:30:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:31:00.604688 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG dbcounter [-] [117988] Writing DB stats nova_api:SELECT=28 {{(pid=117988) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:31:00.606264 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG dbcounter [-] [117988] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117988) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:31:00.610597 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-81cc4d14-0f55-4de8-866e-133e2aa2dc40 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:31:00.611088 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-81cc4d14-0f55-4de8-866e-133e2aa2dc40 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] [instance: e64254d9-b532-4900-ae02-13cf7c68b1d7] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:31:00.618814 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-81cc4d14-0f55-4de8-866e-133e2aa2dc40 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:00.619258 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-81cc4d14-0f55-4de8-866e-133e2aa2dc40 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:00.620029 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-81cc4d14-0f55-4de8-866e-133e2aa2dc40 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:00.621096 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-81cc4d14-0f55-4de8-866e-133e2aa2dc40 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:00.772090 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.objects.instance [None req-81cc4d14-0f55-4de8-866e-133e2aa2dc40 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lazy-loading 'services' on Instance uuid e64254d9-b532-4900-ae02-13cf7c68b1d7 {{(pid=117988) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 13:31:00.895049 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-81cc4d14-0f55-4de8-866e-133e2aa2dc40 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] 10.222.0.23 "DELETE /compute/v2.1/servers/e64254d9-b532-4900-ae02-13cf7c68b1d7/os-volume_attachments/44bc672f-8024-4c91-ac9f-3a5b29d95cf6" status: 202 len: 0 microversion: 2.1 time: 0.291581 Jul 12 13:31:00.895896 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 174/344] 10.222.0.23 () {58 vars in 1415 bytes} [Tue Jul 12 13:31:00 2022] DELETE /compute/v2.1/servers/e64254d9-b532-4900-ae02-13cf7c68b1d7/os-volume_attachments/44bc672f-8024-4c91-ac9f-3a5b29d95cf6 => generated 0 bytes in 293 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 13:31:06.259298 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-e02f0d53-04db-4150-b229-0935848f537e tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1845669238", "imageRef": "ce5a4b61-4265-43de-a33e-a23a4c9f612d", "flavorRef": "452"}} {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:31:06.266884 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG dbcounter [-] [117987] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=4 {{(pid=117987) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:31:06.267742 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG dbcounter [-] [117987] Writing DB stats nova_cell1:SELECT=66 {{(pid=117987) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:31:06.322379 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.network.neutron [None req-e02f0d53-04db-4150-b229-0935848f537e tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] validate_networks() for None {{(pid=117987) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 13:31:06.635515 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.virt.hardware [None req-e02f0d53-04db-4150-b229-0935848f537e tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] Flavor limits 0:0:0 {{(pid=117987) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 13:31:06.637056 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.virt.hardware [None req-e02f0d53-04db-4150-b229-0935848f537e tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] Image limits 0:0:0 {{(pid=117987) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 13:31:06.638210 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.virt.hardware [None req-e02f0d53-04db-4150-b229-0935848f537e tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] Flavor pref 0:0:0 {{(pid=117987) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 13:31:06.638904 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.virt.hardware [None req-e02f0d53-04db-4150-b229-0935848f537e tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] Image pref 0:0:0 {{(pid=117987) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 13:31:06.639705 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.virt.hardware [None req-e02f0d53-04db-4150-b229-0935848f537e tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117987) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 13:31:06.653505 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-e02f0d53-04db-4150-b229-0935848f537e tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:06.654245 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-e02f0d53-04db-4150-b229-0935848f537e tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:06.655314 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-e02f0d53-04db-4150-b229-0935848f537e tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:06.655752 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-e02f0d53-04db-4150-b229-0935848f537e tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:06.676908 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.quota [None req-e02f0d53-04db-4150-b229-0935848f537e tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] Getting quotas for project 8e6e26c4c8f940e883e9e5548a0318ca. Resources: {'ram', 'cores', 'instances'} {{(pid=117987) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 13:31:06.681876 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.quota [None req-e02f0d53-04db-4150-b229-0935848f537e tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] Getting quotas for user 51d0218137d049d199521460a0211504 and project 8e6e26c4c8f940e883e9e5548a0318ca. Resources: {'ram', 'cores', 'instances'} {{(pid=117987) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 13:31:06.695511 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-e02f0d53-04db-4150-b229-0935848f537e tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] Going to run 1 instances... {{(pid=117987) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 13:31:06.698060 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-e02f0d53-04db-4150-b229-0935848f537e tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] [instance: 5f03387e-b691-45e7-a2b3-f1a66610e66b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ce5a4b61-4265-43de-a33e-a23a4c9f612d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117987) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 13:31:06.762495 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-e02f0d53-04db-4150-b229-0935848f537e tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.507921 Jul 12 13:31:06.763259 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 171/345] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 12 13:31:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 510 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 13:31:06.774589 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-a5370b18-ee96-4306-a59e-5854b12c8e7d tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:31:06.775920 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-a5370b18-ee96-4306-a59e-5854b12c8e7d tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] [instance: 5f03387e-b691-45e7-a2b3-f1a66610e66b] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:31:06.840023 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-a5370b18-ee96-4306-a59e-5854b12c8e7d tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d0218137d049d199521460a0211504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6e26c4c8f940e883e9e5548a0318ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:31:06.848742 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-a5370b18-ee96-4306-a59e-5854b12c8e7d tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] 10.222.0.23 "GET /compute/v2.1/servers/5f03387e-b691-45e7-a2b3-f1a66610e66b" status: 200 len: 1215 microversion: 2.1 time: 0.078708 Jul 12 13:31:06.849505 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 175/346] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:31:06 2022] GET /compute/v2.1/servers/5f03387e-b691-45e7-a2b3-f1a66610e66b => generated 1215 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:31:07.325778 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-6d679b62-e5ab-4a00-a648-6a94b4fe9e35 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:31:07.327878 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-6d679b62-e5ab-4a00-a648-6a94b4fe9e35 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] [instance: e64254d9-b532-4900-ae02-13cf7c68b1d7] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:31:07.335588 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-6d679b62-e5ab-4a00-a648-6a94b4fe9e35 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:07.336025 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-6d679b62-e5ab-4a00-a648-6a94b4fe9e35 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:07.336996 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-6d679b62-e5ab-4a00-a648-6a94b4fe9e35 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:07.339613 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-6d679b62-e5ab-4a00-a648-6a94b4fe9e35 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:07.379658 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-6d679b62-e5ab-4a00-a648-6a94b4fe9e35 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] [instance: e64254d9-b532-4900-ae02-13cf7c68b1d7] Going to try to terminate instance {{(pid=117987) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 13:31:07.472688 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-6d679b62-e5ab-4a00-a648-6a94b4fe9e35 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] 10.222.0.23 "DELETE /compute/v2.1/servers/e64254d9-b532-4900-ae02-13cf7c68b1d7" status: 204 len: 0 microversion: 2.1 time: 0.151348 Jul 12 13:31:07.473568 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 172/347] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 12 13:31:07 2022] DELETE /compute/v2.1/servers/e64254d9-b532-4900-ae02-13cf7c68b1d7 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 13:31:07.482525 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-9e148d82-ec84-4867-9025-8e2a0c8f6415 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:31:07.483141 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-9e148d82-ec84-4867-9025-8e2a0c8f6415 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] [instance: e64254d9-b532-4900-ae02-13cf7c68b1d7] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:31:07.490191 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-9e148d82-ec84-4867-9025-8e2a0c8f6415 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:07.490645 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-9e148d82-ec84-4867-9025-8e2a0c8f6415 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:07.491462 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-9e148d82-ec84-4867-9025-8e2a0c8f6415 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:07.491903 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-9e148d82-ec84-4867-9025-8e2a0c8f6415 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:07.627463 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-9e148d82-ec84-4867-9025-8e2a0c8f6415 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd582e9b7a49c4ea6b9a1d6986d6f4163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86acb815cd62409d9856563af3037d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:31:07.635563 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-9e148d82-ec84-4867-9025-8e2a0c8f6415 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] 10.222.0.23 "GET /compute/v2.1/servers/e64254d9-b532-4900-ae02-13cf7c68b1d7" status: 200 len: 1512 microversion: 2.1 time: 0.157035 Jul 12 13:31:07.637300 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 176/348] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:31:07 2022] GET /compute/v2.1/servers/e64254d9-b532-4900-ae02-13cf7c68b1d7 => generated 1512 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:31:07.866681 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-3cc049cc-86f6-4dca-bc29-fb683fa0ac7d tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:31:07.867384 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-3cc049cc-86f6-4dca-bc29-fb683fa0ac7d tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] [instance: 5f03387e-b691-45e7-a2b3-f1a66610e66b] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:31:07.874623 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-3cc049cc-86f6-4dca-bc29-fb683fa0ac7d tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:07.875075 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-3cc049cc-86f6-4dca-bc29-fb683fa0ac7d tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:07.875848 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-3cc049cc-86f6-4dca-bc29-fb683fa0ac7d tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:07.876286 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-3cc049cc-86f6-4dca-bc29-fb683fa0ac7d tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:07.939253 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-3cc049cc-86f6-4dca-bc29-fb683fa0ac7d tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d0218137d049d199521460a0211504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6e26c4c8f940e883e9e5548a0318ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:31:07.946750 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-3cc049cc-86f6-4dca-bc29-fb683fa0ac7d tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] 10.222.0.23 "GET /compute/v2.1/servers/5f03387e-b691-45e7-a2b3-f1a66610e66b" status: 200 len: 1211 microversion: 2.1 time: 0.084273 Jul 12 13:31:07.947315 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 173/349] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:31:07 2022] GET /compute/v2.1/servers/5f03387e-b691-45e7-a2b3-f1a66610e66b => generated 1211 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:31:08.654408 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-d91493d9-08bf-49bc-be64-8cbd2ff7d4e9 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:31:08.654951 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-d91493d9-08bf-49bc-be64-8cbd2ff7d4e9 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] [instance: e64254d9-b532-4900-ae02-13cf7c68b1d7] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:31:08.661908 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-d91493d9-08bf-49bc-be64-8cbd2ff7d4e9 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:08.662351 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-d91493d9-08bf-49bc-be64-8cbd2ff7d4e9 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:08.664151 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-d91493d9-08bf-49bc-be64-8cbd2ff7d4e9 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:08.665445 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-d91493d9-08bf-49bc-be64-8cbd2ff7d4e9 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:08.821314 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-d91493d9-08bf-49bc-be64-8cbd2ff7d4e9 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd582e9b7a49c4ea6b9a1d6986d6f4163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86acb815cd62409d9856563af3037d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:31:08.830568 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-d91493d9-08bf-49bc-be64-8cbd2ff7d4e9 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] 10.222.0.23 "GET /compute/v2.1/servers/e64254d9-b532-4900-ae02-13cf7c68b1d7" status: 200 len: 1512 microversion: 2.1 time: 0.180729 Jul 12 13:31:08.831271 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 177/350] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:31:08 2022] GET /compute/v2.1/servers/e64254d9-b532-4900-ae02-13cf7c68b1d7 => generated 1512 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:31:08.974442 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-e8ab4ab9-3531-433f-a16c-e7c4db42df99 tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:31:08.975820 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-e8ab4ab9-3531-433f-a16c-e7c4db42df99 tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] [instance: 5f03387e-b691-45e7-a2b3-f1a66610e66b] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:31:08.983725 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-e8ab4ab9-3531-433f-a16c-e7c4db42df99 tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:08.984173 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-e8ab4ab9-3531-433f-a16c-e7c4db42df99 tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:08.984949 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-e8ab4ab9-3531-433f-a16c-e7c4db42df99 tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:08.985404 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-e8ab4ab9-3531-433f-a16c-e7c4db42df99 tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:09.056864 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-e8ab4ab9-3531-433f-a16c-e7c4db42df99 tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d0218137d049d199521460a0211504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6e26c4c8f940e883e9e5548a0318ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:31:09.070264 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-e8ab4ab9-3531-433f-a16c-e7c4db42df99 tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] 10.222.0.23 "GET /compute/v2.1/servers/5f03387e-b691-45e7-a2b3-f1a66610e66b" status: 200 len: 1211 microversion: 2.1 time: 0.099990 Jul 12 13:31:09.070869 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 174/351] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:31:08 2022] GET /compute/v2.1/servers/5f03387e-b691-45e7-a2b3-f1a66610e66b => generated 1211 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:31:09.848118 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-19a8cfc0-b06d-4cc8-ac19-efc35035e8fe tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:31:09.848760 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-19a8cfc0-b06d-4cc8-ac19-efc35035e8fe tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] [instance: e64254d9-b532-4900-ae02-13cf7c68b1d7] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:31:09.855737 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-19a8cfc0-b06d-4cc8-ac19-efc35035e8fe tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:09.856239 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-19a8cfc0-b06d-4cc8-ac19-efc35035e8fe tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:09.857586 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-19a8cfc0-b06d-4cc8-ac19-efc35035e8fe tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:09.858182 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-19a8cfc0-b06d-4cc8-ac19-efc35035e8fe tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:09.991895 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-19a8cfc0-b06d-4cc8-ac19-efc35035e8fe tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd582e9b7a49c4ea6b9a1d6986d6f4163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86acb815cd62409d9856563af3037d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:31:10.001114 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-19a8cfc0-b06d-4cc8-ac19-efc35035e8fe tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] 10.222.0.23 "GET /compute/v2.1/servers/e64254d9-b532-4900-ae02-13cf7c68b1d7" status: 200 len: 1512 microversion: 2.1 time: 0.156748 Jul 12 13:31:10.001736 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 178/352] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:31:09 2022] GET /compute/v2.1/servers/e64254d9-b532-4900-ae02-13cf7c68b1d7 => generated 1512 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:31:10.088171 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-84a7e5c4-cf34-45a8-b79a-9225bda9ec01 tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:31:10.088710 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-84a7e5c4-cf34-45a8-b79a-9225bda9ec01 tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] [instance: 5f03387e-b691-45e7-a2b3-f1a66610e66b] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:31:10.096459 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-84a7e5c4-cf34-45a8-b79a-9225bda9ec01 tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:10.096984 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-84a7e5c4-cf34-45a8-b79a-9225bda9ec01 tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:10.097795 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-84a7e5c4-cf34-45a8-b79a-9225bda9ec01 tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:10.098284 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-84a7e5c4-cf34-45a8-b79a-9225bda9ec01 tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:10.170330 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-84a7e5c4-cf34-45a8-b79a-9225bda9ec01 tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d0218137d049d199521460a0211504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6e26c4c8f940e883e9e5548a0318ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:31:10.178684 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-84a7e5c4-cf34-45a8-b79a-9225bda9ec01 tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] 10.222.0.23 "GET /compute/v2.1/servers/5f03387e-b691-45e7-a2b3-f1a66610e66b" status: 200 len: 1267 microversion: 2.1 time: 0.094390 Jul 12 13:31:10.189199 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 175/353] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:31:10 2022] GET /compute/v2.1/servers/5f03387e-b691-45e7-a2b3-f1a66610e66b => generated 1267 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:31:10.717412 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [req-82913c49-32c1-481a-8ad1-c75a3db613ba req-fa0a1397-dcf7-47cc-a982-242c53f7e419 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e64254d9-b532-4900-ae02-13cf7c68b1d7", "name": "network-vif-deleted", "tag": "a0f2f229-d3af-4b60-9b26-bd8a0494e9f9"}]} {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:31:10.740004 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [req-82913c49-32c1-481a-8ad1-c75a3db613ba req-fa0a1397-dcf7-47cc-a982-242c53f7e419 service nova] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:10.741575 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [req-82913c49-32c1-481a-8ad1-c75a3db613ba req-fa0a1397-dcf7-47cc-a982-242c53f7e419 service nova] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:10.764309 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.compute.server_external_events [req-82913c49-32c1-481a-8ad1-c75a3db613ba req-fa0a1397-dcf7-47cc-a982-242c53f7e419 service nova] Creating event network-vif-deleted:a0f2f229-d3af-4b60-9b26-bd8a0494e9f9 for instance e64254d9-b532-4900-ae02-13cf7c68b1d7 on hv-cinder-82002 Jul 12 13:31:10.772502 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [req-82913c49-32c1-481a-8ad1-c75a3db613ba req-fa0a1397-dcf7-47cc-a982-242c53f7e419 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061659 Jul 12 13:31:10.777588 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 179/354] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 12 13:31:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:31:11.018406 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-e7f0ddee-3902-4149-aea6-5224b75164d4 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:31:11.019017 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-e7f0ddee-3902-4149-aea6-5224b75164d4 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] [instance: e64254d9-b532-4900-ae02-13cf7c68b1d7] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:31:11.025221 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-e7f0ddee-3902-4149-aea6-5224b75164d4 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:11.025707 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-e7f0ddee-3902-4149-aea6-5224b75164d4 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:11.026526 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-e7f0ddee-3902-4149-aea6-5224b75164d4 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:11.026964 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-e7f0ddee-3902-4149-aea6-5224b75164d4 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:11.060103 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-e7f0ddee-3902-4149-aea6-5224b75164d4 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:11.060560 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-e7f0ddee-3902-4149-aea6-5224b75164d4 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:11.061010 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.objects.instance [None req-e7f0ddee-3902-4149-aea6-5224b75164d4 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lazy-loading 'fault' on Instance uuid e64254d9-b532-4900-ae02-13cf7c68b1d7 {{(pid=117987) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 13:31:11.108341 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-e7f0ddee-3902-4149-aea6-5224b75164d4 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd582e9b7a49c4ea6b9a1d6986d6f4163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86acb815cd62409d9856563af3037d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:31:11.116818 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-e7f0ddee-3902-4149-aea6-5224b75164d4 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] 10.222.0.23 "GET /compute/v2.1/servers/e64254d9-b532-4900-ae02-13cf7c68b1d7" status: 200 len: 1308 microversion: 2.1 time: 0.102280 Jul 12 13:31:11.117427 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 176/355] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:31:11 2022] GET /compute/v2.1/servers/e64254d9-b532-4900-ae02-13cf7c68b1d7 => generated 1308 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:31:11.198997 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-bfb896b3-7b3f-4f7c-a71c-c888fb986038 tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:31:11.199790 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-bfb896b3-7b3f-4f7c-a71c-c888fb986038 tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] [instance: 5f03387e-b691-45e7-a2b3-f1a66610e66b] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:31:11.206154 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-bfb896b3-7b3f-4f7c-a71c-c888fb986038 tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:11.206678 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-bfb896b3-7b3f-4f7c-a71c-c888fb986038 tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:11.207546 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-bfb896b3-7b3f-4f7c-a71c-c888fb986038 tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:11.208061 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-bfb896b3-7b3f-4f7c-a71c-c888fb986038 tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:11.376309 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-bfb896b3-7b3f-4f7c-a71c-c888fb986038 tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d0218137d049d199521460a0211504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6e26c4c8f940e883e9e5548a0318ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:31:11.386351 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-bfb896b3-7b3f-4f7c-a71c-c888fb986038 tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] 10.222.0.23 "GET /compute/v2.1/servers/5f03387e-b691-45e7-a2b3-f1a66610e66b" status: 200 len: 1315 microversion: 2.1 time: 0.192187 Jul 12 13:31:11.389493 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 180/356] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:31:11 2022] GET /compute/v2.1/servers/5f03387e-b691-45e7-a2b3-f1a66610e66b => generated 1315 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:31:12.062061 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [req-465fa7b5-7a08-4e40-bf73-2ad5a811f10e req-388f4a6d-52de-4e97-9c5b-3c28ee34e850 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f03387e-b691-45e7-a2b3-f1a66610e66b", "tag": "0986f227-e7ec-4c02-8bb4-98ccbec331f5"}]} {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:31:12.074488 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [req-465fa7b5-7a08-4e40-bf73-2ad5a811f10e req-388f4a6d-52de-4e97-9c5b-3c28ee34e850 service nova] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:12.075225 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [req-465fa7b5-7a08-4e40-bf73-2ad5a811f10e req-388f4a6d-52de-4e97-9c5b-3c28ee34e850 service nova] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:12.087157 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.compute.server_external_events [req-465fa7b5-7a08-4e40-bf73-2ad5a811f10e req-388f4a6d-52de-4e97-9c5b-3c28ee34e850 service nova] Creating event network-changed:0986f227-e7ec-4c02-8bb4-98ccbec331f5 for instance 5f03387e-b691-45e7-a2b3-f1a66610e66b on hv-cinder-82002 Jul 12 13:31:12.092807 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [req-465fa7b5-7a08-4e40-bf73-2ad5a811f10e req-388f4a6d-52de-4e97-9c5b-3c28ee34e850 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037266 Jul 12 13:31:12.093447 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 177/357] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 12 13:31:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:31:12.134588 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-69481530-67ea-4a5d-a23c-dbc232ff4d48 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:31:12.135476 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-69481530-67ea-4a5d-a23c-dbc232ff4d48 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] [instance: e64254d9-b532-4900-ae02-13cf7c68b1d7] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:31:12.143132 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-69481530-67ea-4a5d-a23c-dbc232ff4d48 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:12.143583 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-69481530-67ea-4a5d-a23c-dbc232ff4d48 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:12.144391 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-69481530-67ea-4a5d-a23c-dbc232ff4d48 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:12.144828 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-69481530-67ea-4a5d-a23c-dbc232ff4d48 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:12.159829 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.wsgi [None req-69481530-67ea-4a5d-a23c-dbc232ff4d48 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] HTTP exception thrown: Instance e64254d9-b532-4900-ae02-13cf7c68b1d7 could not be found. Jul 12 13:31:12.161532 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-69481530-67ea-4a5d-a23c-dbc232ff4d48 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Request method failure captured: Jul 12 13:31:12.161532 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: request: GET /compute/v2.1/servers/e64254d9-b532-4900-ae02-13cf7c68b1d7 HTTP/1.1 Jul 12 13:31:12.161532 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: Accept: application/json Jul 12 13:31:12.161532 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: Accept-Encoding: identity Jul 12 13:31:12.161532 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: Connection: close Jul 12 13:31:12.161532 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: Content-Length: 0 Jul 12 13:31:12.161532 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: Content-Type: application/json Jul 12 13:31:12.161532 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: Host: 10.222.0.23 Jul 12 13:31:12.161532 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: Openstack-System-Scope: None Jul 12 13:31:12.161532 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: User-Agent: python-urllib3/1.26.9 Jul 12 13:31:12.161532 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Auth-Token: gAAAAABizXcvP8yOYJDtE0nLNZQREhEA0hriD0_gfcsEWud2qhed-jMHrYhVqNU7GmpvISg6aHk-KX_t3II-lEr0ucG79Cxtk5XD6FJlhNV1fuLo0bWxzr-_XodVr64SP9qCIdnRJThO31pEpdj8fgzGkDWAsmRYXd69dDmSJwIt4mjxzjjKg9Y Jul 12 13:31:12.161532 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Domain-Id: None Jul 12 13:31:12.161532 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Domain-Name: None Jul 12 13:31:12.161532 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Identity-Status: Confirmed Jul 12 13:31:12.161532 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Is-Admin-Project: True Jul 12 13:31:12.161532 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Project-Domain-Id: default Jul 12 13:31:12.161532 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Project-Domain-Name: Default Jul 12 13:31:12.161532 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Project-Id: 86acb815cd62409d9856563af3037d38 Jul 12 13:31:12.161532 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Project-Name: tempest-VolumesSnapshotTestJSON-219654305 Jul 12 13:31:12.161532 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Role: reader,member Jul 12 13:31:12.161532 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Roles: reader,member Jul 12 13:31:12.162786 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/86acb815cd62409d9856563af3037d38"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_86acb815cd62409d9856563af3037d38", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/86acb815cd62409d9856563af3037d38"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/86acb815cd62409d9856563af3037d38"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] Jul 12 13:31:12.162786 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Tenant: tempest-VolumesSnapshotTestJSON-219654305 Jul 12 13:31:12.162786 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Tenant-Id: 86acb815cd62409d9856563af3037d38 Jul 12 13:31:12.162786 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-219654305 Jul 12 13:31:12.162786 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-User: tempest-VolumesSnapshotTestJSON-219654305-project Jul 12 13:31:12.162786 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-User-Domain-Id: default Jul 12 13:31:12.162786 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-User-Domain-Name: Default Jul 12 13:31:12.162786 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-User-Id: d582e9b7a49c4ea6b9a1d6986d6f4163 Jul 12 13:31:12.162786 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-User-Name: tempest-VolumesSnapshotTestJSON-219654305-project Jul 12 13:31:12.162786 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: method: > Jul 12 13:31:12.162786 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: exception: Instance e64254d9-b532-4900-ae02-13cf7c68b1d7 could not be found. Jul 12 13:31:12.162786 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: action_args: {'id': 'e64254d9-b532-4900-ae02-13cf7c68b1d7'} Jul 12 13:31:12.163949 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 13:31:12.163949 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:31:12.163949 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 13:31:12.163949 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 13:31:12.163949 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 13:31:12.163949 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 13:31:12.163949 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 13:31:12.163949 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 13:31:12.163949 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 13:31:12.163949 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 13:31:12.163949 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e64254d9-b532-4900-ae02-13cf7c68b1d7 could not be found. Jul 12 13:31:12.163949 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi Jul 12 13:31:12.163949 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:31:12.163949 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi Jul 12 13:31:12.163949 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:31:12.163949 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:31:12.163949 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:31:12.163949 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 13:31:12.163949 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 13:31:12.163949 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 13:31:12.165738 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:31:12.165738 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 13:31:12.165738 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 13:31:12.165738 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 13:31:12.165738 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 13:31:12.165738 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 13:31:12.165738 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 13:31:12.165738 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e64254d9-b532-4900-ae02-13cf7c68b1d7 could not be found. Jul 12 13:31:12.165738 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi Jul 12 13:31:12.165738 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:31:12.165738 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi Jul 12 13:31:12.165738 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:31:12.165738 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:31:12.165738 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:31:12.165738 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 13:31:12.165738 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 13:31:12.165738 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e64254d9-b532-4900-ae02-13cf7c68b1d7 could not be found. Jul 12 13:31:12.165738 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi Jul 12 13:31:12.166796 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-69481530-67ea-4a5d-a23c-dbc232ff4d48 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Returning 404 to user: Instance e64254d9-b532-4900-ae02-13cf7c68b1d7 could not be found. {{(pid=117988) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 13:31:12.166796 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-69481530-67ea-4a5d-a23c-dbc232ff4d48 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] 10.222.0.23 "GET /compute/v2.1/servers/e64254d9-b532-4900-ae02-13cf7c68b1d7" status: 404 len: 111 microversion: 2.1 time: 0.032638 Jul 12 13:31:12.166796 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 181/358] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:31:12 2022] GET /compute/v2.1/servers/e64254d9-b532-4900-ae02-13cf7c68b1d7 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 13:31:12.406682 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-b071f5a4-c9a9-49dc-b58e-c7ac89405cb0 tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:31:12.407368 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-b071f5a4-c9a9-49dc-b58e-c7ac89405cb0 tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] [instance: 5f03387e-b691-45e7-a2b3-f1a66610e66b] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:31:12.413511 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-b071f5a4-c9a9-49dc-b58e-c7ac89405cb0 tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:12.413950 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-b071f5a4-c9a9-49dc-b58e-c7ac89405cb0 tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:12.414697 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-b071f5a4-c9a9-49dc-b58e-c7ac89405cb0 tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:12.415124 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-b071f5a4-c9a9-49dc-b58e-c7ac89405cb0 tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:12.554919 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-b071f5a4-c9a9-49dc-b58e-c7ac89405cb0 tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d0218137d049d199521460a0211504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6e26c4c8f940e883e9e5548a0318ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:31:12.563549 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-b071f5a4-c9a9-49dc-b58e-c7ac89405cb0 tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] 10.222.0.23 "GET /compute/v2.1/servers/5f03387e-b691-45e7-a2b3-f1a66610e66b" status: 200 len: 1315 microversion: 2.1 time: 0.162178 Jul 12 13:31:12.564397 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 178/359] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:31:12 2022] GET /compute/v2.1/servers/5f03387e-b691-45e7-a2b3-f1a66610e66b => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:31:13.580692 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-a807ec36-9b9d-47fd-a7ca-2288622a9bb7 tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:31:13.581257 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-a807ec36-9b9d-47fd-a7ca-2288622a9bb7 tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] [instance: 5f03387e-b691-45e7-a2b3-f1a66610e66b] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:31:13.588102 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-a807ec36-9b9d-47fd-a7ca-2288622a9bb7 tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:13.588542 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-a807ec36-9b9d-47fd-a7ca-2288622a9bb7 tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:13.590381 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-a807ec36-9b9d-47fd-a7ca-2288622a9bb7 tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:13.590825 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-a807ec36-9b9d-47fd-a7ca-2288622a9bb7 tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:13.729061 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-a807ec36-9b9d-47fd-a7ca-2288622a9bb7 tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d0218137d049d199521460a0211504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6e26c4c8f940e883e9e5548a0318ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:31:13.737806 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-a807ec36-9b9d-47fd-a7ca-2288622a9bb7 tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] 10.222.0.23 "GET /compute/v2.1/servers/5f03387e-b691-45e7-a2b3-f1a66610e66b" status: 200 len: 1315 microversion: 2.1 time: 0.160846 Jul 12 13:31:13.738404 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 182/360] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:31:13 2022] GET /compute/v2.1/servers/5f03387e-b691-45e7-a2b3-f1a66610e66b => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:31:14.756167 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-ac299409-b612-447f-b4d8-cb73593a272c tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:31:14.756776 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-ac299409-b612-447f-b4d8-cb73593a272c tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] [instance: 5f03387e-b691-45e7-a2b3-f1a66610e66b] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:31:14.764413 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-ac299409-b612-447f-b4d8-cb73593a272c tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:14.764861 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-ac299409-b612-447f-b4d8-cb73593a272c tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:14.765660 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-ac299409-b612-447f-b4d8-cb73593a272c tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:14.766094 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-ac299409-b612-447f-b4d8-cb73593a272c tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:14.900473 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-ac299409-b612-447f-b4d8-cb73593a272c tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d0218137d049d199521460a0211504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6e26c4c8f940e883e9e5548a0318ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:31:14.908602 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-ac299409-b612-447f-b4d8-cb73593a272c tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] 10.222.0.23 "GET /compute/v2.1/servers/5f03387e-b691-45e7-a2b3-f1a66610e66b" status: 200 len: 1315 microversion: 2.1 time: 0.156277 Jul 12 13:31:14.909181 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 179/361] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:31:14 2022] GET /compute/v2.1/servers/5f03387e-b691-45e7-a2b3-f1a66610e66b => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:31:15.074088 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-341bc5b8-9dc9-466d-b165-476d5f97ea1e tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:31:15.074648 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-341bc5b8-9dc9-466d-b165-476d5f97ea1e tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] [instance: eeb0b554-cd09-49b5-95f0-22fc7c707944] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:31:15.080620 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-341bc5b8-9dc9-466d-b165-476d5f97ea1e tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:15.081064 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-341bc5b8-9dc9-466d-b165-476d5f97ea1e tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:15.081856 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-341bc5b8-9dc9-466d-b165-476d5f97ea1e tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:15.082290 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-341bc5b8-9dc9-466d-b165-476d5f97ea1e tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:15.106680 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-341bc5b8-9dc9-466d-b165-476d5f97ea1e tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] 10.222.0.23 "GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944/ips" status: 200 len: 147 microversion: 2.1 time: 0.037431 Jul 12 13:31:15.107259 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 183/362] 10.222.0.23 () {58 vars in 1247 bytes} [Tue Jul 12 13:31:15 2022] GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944/ips => generated 147 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:31:15.926730 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-bb308d96-67eb-453b-aa70-915d9ea68f4a tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:31:15.927392 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-bb308d96-67eb-453b-aa70-915d9ea68f4a tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] [instance: 5f03387e-b691-45e7-a2b3-f1a66610e66b] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:31:15.934744 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-bb308d96-67eb-453b-aa70-915d9ea68f4a tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:15.935188 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-bb308d96-67eb-453b-aa70-915d9ea68f4a tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:15.935943 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-bb308d96-67eb-453b-aa70-915d9ea68f4a tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:15.936367 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-bb308d96-67eb-453b-aa70-915d9ea68f4a tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:16.071258 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-bb308d96-67eb-453b-aa70-915d9ea68f4a tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d0218137d049d199521460a0211504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6e26c4c8f940e883e9e5548a0318ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:31:16.079309 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-bb308d96-67eb-453b-aa70-915d9ea68f4a tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] 10.222.0.23 "GET /compute/v2.1/servers/5f03387e-b691-45e7-a2b3-f1a66610e66b" status: 200 len: 1315 microversion: 2.1 time: 0.156616 Jul 12 13:31:16.079877 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 180/363] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:31:15 2022] GET /compute/v2.1/servers/5f03387e-b691-45e7-a2b3-f1a66610e66b => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:31:17.095905 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-b4788a51-5d45-46d7-9a69-3ef54e85232b tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:31:17.096511 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-b4788a51-5d45-46d7-9a69-3ef54e85232b tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] [instance: 5f03387e-b691-45e7-a2b3-f1a66610e66b] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:31:17.099105 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG dbcounter [-] [117988] Writing DB stats nova_cell0:SELECT=2 {{(pid=117988) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:31:17.104421 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-b4788a51-5d45-46d7-9a69-3ef54e85232b tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:17.104923 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-b4788a51-5d45-46d7-9a69-3ef54e85232b tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:17.105718 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-b4788a51-5d45-46d7-9a69-3ef54e85232b tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:17.106152 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-b4788a51-5d45-46d7-9a69-3ef54e85232b tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:17.234114 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-b4788a51-5d45-46d7-9a69-3ef54e85232b tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d0218137d049d199521460a0211504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6e26c4c8f940e883e9e5548a0318ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:31:17.241562 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-b4788a51-5d45-46d7-9a69-3ef54e85232b tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] 10.222.0.23 "GET /compute/v2.1/servers/5f03387e-b691-45e7-a2b3-f1a66610e66b" status: 200 len: 1315 microversion: 2.1 time: 0.149526 Jul 12 13:31:17.242121 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 184/364] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:31:17 2022] GET /compute/v2.1/servers/5f03387e-b691-45e7-a2b3-f1a66610e66b => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:31:18.258050 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-a075aa3a-7e2a-4ba4-a63d-f620bea5862f tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:31:18.258659 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-a075aa3a-7e2a-4ba4-a63d-f620bea5862f tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] [instance: 5f03387e-b691-45e7-a2b3-f1a66610e66b] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:31:18.261444 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG dbcounter [-] [117987] Writing DB stats nova_cell0:SELECT=2 {{(pid=117987) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:31:18.262108 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG dbcounter [-] [117987] Writing DB stats nova_cell0:SELECT=6 {{(pid=117987) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:31:18.267988 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-a075aa3a-7e2a-4ba4-a63d-f620bea5862f tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:18.268440 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-a075aa3a-7e2a-4ba4-a63d-f620bea5862f tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:18.269200 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-a075aa3a-7e2a-4ba4-a63d-f620bea5862f tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:18.269658 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-a075aa3a-7e2a-4ba4-a63d-f620bea5862f tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:18.402751 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-a075aa3a-7e2a-4ba4-a63d-f620bea5862f tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d0218137d049d199521460a0211504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6e26c4c8f940e883e9e5548a0318ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:31:18.410120 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-a075aa3a-7e2a-4ba4-a63d-f620bea5862f tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] 10.222.0.23 "GET /compute/v2.1/servers/5f03387e-b691-45e7-a2b3-f1a66610e66b" status: 200 len: 1315 microversion: 2.1 time: 0.155967 Jul 12 13:31:18.410677 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 181/365] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:31:18 2022] GET /compute/v2.1/servers/5f03387e-b691-45e7-a2b3-f1a66610e66b => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:31:19.427451 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-723557a8-7a7e-451c-ad30-77dbe95f8aa3 tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:31:19.428104 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-723557a8-7a7e-451c-ad30-77dbe95f8aa3 tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] [instance: 5f03387e-b691-45e7-a2b3-f1a66610e66b] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:31:19.434849 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-723557a8-7a7e-451c-ad30-77dbe95f8aa3 tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:19.435294 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-723557a8-7a7e-451c-ad30-77dbe95f8aa3 tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:19.436058 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-723557a8-7a7e-451c-ad30-77dbe95f8aa3 tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:19.436479 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-723557a8-7a7e-451c-ad30-77dbe95f8aa3 tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:19.568792 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-723557a8-7a7e-451c-ad30-77dbe95f8aa3 tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d0218137d049d199521460a0211504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6e26c4c8f940e883e9e5548a0318ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:31:19.576909 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-723557a8-7a7e-451c-ad30-77dbe95f8aa3 tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] 10.222.0.23 "GET /compute/v2.1/servers/5f03387e-b691-45e7-a2b3-f1a66610e66b" status: 200 len: 1315 microversion: 2.1 time: 0.153298 Jul 12 13:31:19.577500 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 185/366] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:31:19 2022] GET /compute/v2.1/servers/5f03387e-b691-45e7-a2b3-f1a66610e66b => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:31:19.788904 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-6bffb1be-0580-4265-88cc-17686d9b6ac8 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8c804a5d-9b3c-4e21-80be-178bb88ab681"}} {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:31:19.790040 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-6bffb1be-0580-4265-88cc-17686d9b6ac8 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] [instance: eeb0b554-cd09-49b5-95f0-22fc7c707944] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:31:19.797250 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-6bffb1be-0580-4265-88cc-17686d9b6ac8 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:19.797735 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-6bffb1be-0580-4265-88cc-17686d9b6ac8 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:19.798492 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-6bffb1be-0580-4265-88cc-17686d9b6ac8 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:19.798923 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-6bffb1be-0580-4265-88cc-17686d9b6ac8 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:20.593492 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-0656dfad-59dd-409d-8ea6-4c1fd194b7ea tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:31:20.594036 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-0656dfad-59dd-409d-8ea6-4c1fd194b7ea tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] [instance: 5f03387e-b691-45e7-a2b3-f1a66610e66b] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:31:20.600693 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-0656dfad-59dd-409d-8ea6-4c1fd194b7ea tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:20.601135 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-0656dfad-59dd-409d-8ea6-4c1fd194b7ea tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:20.601917 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-0656dfad-59dd-409d-8ea6-4c1fd194b7ea tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:20.602342 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-0656dfad-59dd-409d-8ea6-4c1fd194b7ea tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:20.738126 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-0656dfad-59dd-409d-8ea6-4c1fd194b7ea tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d0218137d049d199521460a0211504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6e26c4c8f940e883e9e5548a0318ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:31:20.745406 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-0656dfad-59dd-409d-8ea6-4c1fd194b7ea tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] 10.222.0.23 "GET /compute/v2.1/servers/5f03387e-b691-45e7-a2b3-f1a66610e66b" status: 200 len: 1315 microversion: 2.1 time: 0.155800 Jul 12 13:31:20.746168 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 186/367] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:31:20 2022] GET /compute/v2.1/servers/5f03387e-b691-45e7-a2b3-f1a66610e66b => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:31:21.763758 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-ca55ebed-6cce-43ae-a4be-d3963995101d tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:31:21.764410 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-ca55ebed-6cce-43ae-a4be-d3963995101d tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] [instance: 5f03387e-b691-45e7-a2b3-f1a66610e66b] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:31:21.770783 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-ca55ebed-6cce-43ae-a4be-d3963995101d tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:21.771226 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-ca55ebed-6cce-43ae-a4be-d3963995101d tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:21.771974 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-ca55ebed-6cce-43ae-a4be-d3963995101d tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:21.772403 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-ca55ebed-6cce-43ae-a4be-d3963995101d tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:21.900802 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-ca55ebed-6cce-43ae-a4be-d3963995101d tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d0218137d049d199521460a0211504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6e26c4c8f940e883e9e5548a0318ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:31:21.908167 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-ca55ebed-6cce-43ae-a4be-d3963995101d tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] 10.222.0.23 "GET /compute/v2.1/servers/5f03387e-b691-45e7-a2b3-f1a66610e66b" status: 200 len: 1315 microversion: 2.1 time: 0.148945 Jul 12 13:31:21.908721 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 187/368] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:31:21 2022] GET /compute/v2.1/servers/5f03387e-b691-45e7-a2b3-f1a66610e66b => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:31:22.926543 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-f4cbab69-9e84-48a3-bdff-ce2bebc7e154 tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:31:22.927250 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-f4cbab69-9e84-48a3-bdff-ce2bebc7e154 tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] [instance: 5f03387e-b691-45e7-a2b3-f1a66610e66b] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:31:22.935394 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-f4cbab69-9e84-48a3-bdff-ce2bebc7e154 tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:22.935900 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-f4cbab69-9e84-48a3-bdff-ce2bebc7e154 tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:22.945021 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-f4cbab69-9e84-48a3-bdff-ce2bebc7e154 tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:22.945634 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-f4cbab69-9e84-48a3-bdff-ce2bebc7e154 tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:23.022630 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-6bffb1be-0580-4265-88cc-17686d9b6ac8 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] 10.222.0.23 "POST /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.236211 Jul 12 13:31:23.024913 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 182/369] 10.222.0.23 () {60 vars in 1322 bytes} [Tue Jul 12 13:31:19 2022] POST /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944/os-volume_attachments => generated 194 bytes in 3240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:31:23.182053 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-f4cbab69-9e84-48a3-bdff-ce2bebc7e154 tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d0218137d049d199521460a0211504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6e26c4c8f940e883e9e5548a0318ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:31:23.194195 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-f4cbab69-9e84-48a3-bdff-ce2bebc7e154 tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] 10.222.0.23 "GET /compute/v2.1/servers/5f03387e-b691-45e7-a2b3-f1a66610e66b" status: 200 len: 1315 microversion: 2.1 time: 0.272061 Jul 12 13:31:23.206969 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 188/370] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:31:22 2022] GET /compute/v2.1/servers/5f03387e-b691-45e7-a2b3-f1a66610e66b => generated 1315 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:31:24.205342 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-fbc81f9a-de3c-4b4a-95e7-efc562b5fe20 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1120637980", "imageRef": "ce5a4b61-4265-43de-a33e-a23a4c9f612d", "flavorRef": "452", "networks": [{"uuid": "e80e091e-c604-4ca6-9635-e52ad7941abc"}]}} {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:31:24.214424 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-44ab3881-a1ac-464c-b379-2f53217975a8 tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:31:24.215746 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-44ab3881-a1ac-464c-b379-2f53217975a8 tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] [instance: 5f03387e-b691-45e7-a2b3-f1a66610e66b] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:31:24.224555 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-44ab3881-a1ac-464c-b379-2f53217975a8 tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:24.225663 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-44ab3881-a1ac-464c-b379-2f53217975a8 tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:24.227063 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-44ab3881-a1ac-464c-b379-2f53217975a8 tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:24.228017 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-44ab3881-a1ac-464c-b379-2f53217975a8 tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:24.267965 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.network.neutron [None req-fbc81f9a-de3c-4b4a-95e7-efc562b5fe20 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] validate_networks() for [('e80e091e-c604-4ca6-9635-e52ad7941abc', None, None, None, None, None)] {{(pid=117987) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 13:31:24.663448 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-44ab3881-a1ac-464c-b379-2f53217975a8 tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d0218137d049d199521460a0211504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6e26c4c8f940e883e9e5548a0318ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:31:24.671858 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-44ab3881-a1ac-464c-b379-2f53217975a8 tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] 10.222.0.23 "GET /compute/v2.1/servers/5f03387e-b691-45e7-a2b3-f1a66610e66b" status: 200 len: 1315 microversion: 2.1 time: 0.463610 Jul 12 13:31:24.672804 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 189/371] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:31:24 2022] GET /compute/v2.1/servers/5f03387e-b691-45e7-a2b3-f1a66610e66b => generated 1315 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:31:24.677484 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-8088c500-a0e6-4657-a32e-347b235dfa21 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:31:24.678131 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-8088c500-a0e6-4657-a32e-347b235dfa21 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 5d30ed54-909d-491f-a14c-bc4435cfdc6f] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:31:24.684305 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-8088c500-a0e6-4657-a32e-347b235dfa21 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:24.684769 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-8088c500-a0e6-4657-a32e-347b235dfa21 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:24.686107 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-8088c500-a0e6-4657-a32e-347b235dfa21 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:24.686107 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-8088c500-a0e6-4657-a32e-347b235dfa21 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:24.712998 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-8088c500-a0e6-4657-a32e-347b235dfa21 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f/ips" status: 200 len: 152 microversion: 2.20 time: 0.039058 Jul 12 13:31:24.714135 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 190/372] 10.222.0.23 () {60 vars in 1288 bytes} [Tue Jul 12 13:31:24 2022] GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f/ips => generated 152 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 13:31:24.921849 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.virt.hardware [None req-fbc81f9a-de3c-4b4a-95e7-efc562b5fe20 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Flavor limits 0:0:0 {{(pid=117987) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 13:31:24.922315 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.virt.hardware [None req-fbc81f9a-de3c-4b4a-95e7-efc562b5fe20 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Image limits 0:0:0 {{(pid=117987) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 13:31:24.922832 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.virt.hardware [None req-fbc81f9a-de3c-4b4a-95e7-efc562b5fe20 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Flavor pref 0:0:0 {{(pid=117987) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 13:31:24.923364 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.virt.hardware [None req-fbc81f9a-de3c-4b4a-95e7-efc562b5fe20 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Image pref 0:0:0 {{(pid=117987) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 13:31:24.923775 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.virt.hardware [None req-fbc81f9a-de3c-4b4a-95e7-efc562b5fe20 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117987) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 13:31:24.933052 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-fbc81f9a-de3c-4b4a-95e7-efc562b5fe20 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:24.933531 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-fbc81f9a-de3c-4b4a-95e7-efc562b5fe20 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:24.934330 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-fbc81f9a-de3c-4b4a-95e7-efc562b5fe20 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:24.934768 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-fbc81f9a-de3c-4b4a-95e7-efc562b5fe20 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:24.956353 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.quota [None req-fbc81f9a-de3c-4b4a-95e7-efc562b5fe20 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Getting quotas for project 86acb815cd62409d9856563af3037d38. Resources: {'ram', 'cores', 'instances'} {{(pid=117987) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 13:31:24.962273 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.quota [None req-fbc81f9a-de3c-4b4a-95e7-efc562b5fe20 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Getting quotas for user d582e9b7a49c4ea6b9a1d6986d6f4163 and project 86acb815cd62409d9856563af3037d38. Resources: {'ram', 'cores', 'instances'} {{(pid=117987) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 13:31:24.976591 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-fbc81f9a-de3c-4b4a-95e7-efc562b5fe20 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Going to run 1 instances... {{(pid=117987) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 13:31:24.978994 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-fbc81f9a-de3c-4b4a-95e7-efc562b5fe20 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] [instance: c547ded0-7a14-4d94-b2e2-0434481aaa17] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ce5a4b61-4265-43de-a33e-a23a4c9f612d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117987) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 13:31:25.062252 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-fbc81f9a-de3c-4b4a-95e7-efc562b5fe20 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.861169 Jul 12 13:31:25.063131 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 183/373] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 12 13:31:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 863 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 13:31:25.078601 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-7108ef13-cf11-47f1-86a3-6ad933ca1c96 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:31:25.081240 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-7108ef13-cf11-47f1-86a3-6ad933ca1c96 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] [instance: c547ded0-7a14-4d94-b2e2-0434481aaa17] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:31:25.207492 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-7108ef13-cf11-47f1-86a3-6ad933ca1c96 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd582e9b7a49c4ea6b9a1d6986d6f4163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86acb815cd62409d9856563af3037d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:31:25.219590 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-7108ef13-cf11-47f1-86a3-6ad933ca1c96 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] 10.222.0.23 "GET /compute/v2.1/servers/c547ded0-7a14-4d94-b2e2-0434481aaa17" status: 200 len: 1219 microversion: 2.1 time: 0.149537 Jul 12 13:31:25.220749 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 191/374] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:31:25 2022] GET /compute/v2.1/servers/c547ded0-7a14-4d94-b2e2-0434481aaa17 => generated 1219 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:31:25.252807 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [req-e25b9489-9558-47a6-98fa-d33f9b6e91bf req-0eb00109-40a3-45c0-b080-cd432db9a8f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f03387e-b691-45e7-a2b3-f1a66610e66b", "name": "network-vif-plugged", "status": "completed", "tag": "0986f227-e7ec-4c02-8bb4-98ccbec331f5"}]} {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:31:25.263982 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [req-e25b9489-9558-47a6-98fa-d33f9b6e91bf req-0eb00109-40a3-45c0-b080-cd432db9a8f8 service nova] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:25.264433 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [req-e25b9489-9558-47a6-98fa-d33f9b6e91bf req-0eb00109-40a3-45c0-b080-cd432db9a8f8 service nova] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:25.280084 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.compute.server_external_events [req-e25b9489-9558-47a6-98fa-d33f9b6e91bf req-0eb00109-40a3-45c0-b080-cd432db9a8f8 service nova] Creating event network-vif-plugged:0986f227-e7ec-4c02-8bb4-98ccbec331f5 for instance 5f03387e-b691-45e7-a2b3-f1a66610e66b on hv-cinder-82002 Jul 12 13:31:25.285324 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [req-e25b9489-9558-47a6-98fa-d33f9b6e91bf req-0eb00109-40a3-45c0-b080-cd432db9a8f8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040581 Jul 12 13:31:25.286578 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 184/375] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 12 13:31:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:31:25.688192 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-3d90b7d3-e735-439b-8867-545d8080c8b2 tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:31:25.688712 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-3d90b7d3-e735-439b-8867-545d8080c8b2 tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] [instance: 5f03387e-b691-45e7-a2b3-f1a66610e66b] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:31:25.695485 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-3d90b7d3-e735-439b-8867-545d8080c8b2 tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:25.695931 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-3d90b7d3-e735-439b-8867-545d8080c8b2 tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:25.696691 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-3d90b7d3-e735-439b-8867-545d8080c8b2 tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:25.697122 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-3d90b7d3-e735-439b-8867-545d8080c8b2 tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:25.832827 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-3d90b7d3-e735-439b-8867-545d8080c8b2 tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d0218137d049d199521460a0211504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6e26c4c8f940e883e9e5548a0318ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:31:25.846232 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-3d90b7d3-e735-439b-8867-545d8080c8b2 tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] 10.222.0.23 "GET /compute/v2.1/servers/5f03387e-b691-45e7-a2b3-f1a66610e66b" status: 200 len: 1315 microversion: 2.1 time: 0.161840 Jul 12 13:31:25.847006 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 192/376] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:31:25 2022] GET /compute/v2.1/servers/5f03387e-b691-45e7-a2b3-f1a66610e66b => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:31:26.237833 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-ab49fd8c-ba93-4f18-ac82-2253d333041b tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:31:26.238613 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-ab49fd8c-ba93-4f18-ac82-2253d333041b tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] [instance: c547ded0-7a14-4d94-b2e2-0434481aaa17] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:31:26.245492 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-ab49fd8c-ba93-4f18-ac82-2253d333041b tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:26.245887 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-ab49fd8c-ba93-4f18-ac82-2253d333041b tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:26.246752 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-ab49fd8c-ba93-4f18-ac82-2253d333041b tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:26.247185 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-ab49fd8c-ba93-4f18-ac82-2253d333041b tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:26.315704 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-ab49fd8c-ba93-4f18-ac82-2253d333041b tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd582e9b7a49c4ea6b9a1d6986d6f4163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86acb815cd62409d9856563af3037d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:31:26.324994 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-ab49fd8c-ba93-4f18-ac82-2253d333041b tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] 10.222.0.23 "GET /compute/v2.1/servers/c547ded0-7a14-4d94-b2e2-0434481aaa17" status: 200 len: 1223 microversion: 2.1 time: 0.092204 Jul 12 13:31:26.325838 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 185/377] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:31:26 2022] GET /compute/v2.1/servers/c547ded0-7a14-4d94-b2e2-0434481aaa17 => generated 1223 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:31:26.863626 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-4acd72bb-c970-4a66-a400-37c78ec67160 tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:31:26.864249 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-4acd72bb-c970-4a66-a400-37c78ec67160 tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] [instance: 5f03387e-b691-45e7-a2b3-f1a66610e66b] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:31:26.872890 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-4acd72bb-c970-4a66-a400-37c78ec67160 tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:26.873344 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-4acd72bb-c970-4a66-a400-37c78ec67160 tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:26.874145 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-4acd72bb-c970-4a66-a400-37c78ec67160 tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:26.874584 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-4acd72bb-c970-4a66-a400-37c78ec67160 tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:27.012583 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-4acd72bb-c970-4a66-a400-37c78ec67160 tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d0218137d049d199521460a0211504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6e26c4c8f940e883e9e5548a0318ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:31:27.015987 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG dbcounter [-] [117988] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117988) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:31:27.020961 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-4acd72bb-c970-4a66-a400-37c78ec67160 tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] 10.222.0.23 "GET /compute/v2.1/servers/5f03387e-b691-45e7-a2b3-f1a66610e66b" status: 200 len: 1315 microversion: 2.1 time: 0.161233 Jul 12 13:31:27.021557 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 193/378] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:31:26 2022] GET /compute/v2.1/servers/5f03387e-b691-45e7-a2b3-f1a66610e66b => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:31:27.342317 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-4e04e0fe-a302-4195-a263-6c5758e88db8 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:31:27.342918 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-4e04e0fe-a302-4195-a263-6c5758e88db8 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] [instance: c547ded0-7a14-4d94-b2e2-0434481aaa17] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:31:27.349950 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-4e04e0fe-a302-4195-a263-6c5758e88db8 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:27.350393 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-4e04e0fe-a302-4195-a263-6c5758e88db8 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:27.351149 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-4e04e0fe-a302-4195-a263-6c5758e88db8 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:27.351633 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-4e04e0fe-a302-4195-a263-6c5758e88db8 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:27.417171 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-4e04e0fe-a302-4195-a263-6c5758e88db8 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd582e9b7a49c4ea6b9a1d6986d6f4163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86acb815cd62409d9856563af3037d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:31:27.420734 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG dbcounter [-] [117987] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117987) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:31:27.425885 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-4e04e0fe-a302-4195-a263-6c5758e88db8 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] 10.222.0.23 "GET /compute/v2.1/servers/c547ded0-7a14-4d94-b2e2-0434481aaa17" status: 200 len: 1271 microversion: 2.1 time: 0.087299 Jul 12 13:31:27.426460 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 186/379] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:31:27 2022] GET /compute/v2.1/servers/c547ded0-7a14-4d94-b2e2-0434481aaa17 => generated 1271 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:31:27.705621 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-36677d80-25ca-44aa-8ddf-31d1d00071c6 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:31:27.706180 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-36677d80-25ca-44aa-8ddf-31d1d00071c6 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 5d30ed54-909d-491f-a14c-bc4435cfdc6f] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:31:27.714516 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-36677d80-25ca-44aa-8ddf-31d1d00071c6 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:27.715389 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-36677d80-25ca-44aa-8ddf-31d1d00071c6 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:27.716218 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-36677d80-25ca-44aa-8ddf-31d1d00071c6 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:27.716840 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-36677d80-25ca-44aa-8ddf-31d1d00071c6 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:27.740935 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.objects.instance [None req-36677d80-25ca-44aa-8ddf-31d1d00071c6 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lazy-loading 'flavor' on Instance uuid 5d30ed54-909d-491f-a14c-bc4435cfdc6f {{(pid=117988) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 13:31:28.038643 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-c1f365b6-157f-4e43-b22d-8060d207ac66 tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:31:28.039265 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-c1f365b6-157f-4e43-b22d-8060d207ac66 tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] [instance: 5f03387e-b691-45e7-a2b3-f1a66610e66b] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:31:28.052287 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-c1f365b6-157f-4e43-b22d-8060d207ac66 tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:28.052868 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-c1f365b6-157f-4e43-b22d-8060d207ac66 tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:28.053943 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-c1f365b6-157f-4e43-b22d-8060d207ac66 tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:28.054388 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-c1f365b6-157f-4e43-b22d-8060d207ac66 tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:28.090883 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-36677d80-25ca-44aa-8ddf-31d1d00071c6 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "POST /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f/action" status: 202 len: 0 microversion: 2.20 time: 0.389647 Jul 12 13:31:28.091534 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 194/380] 10.222.0.23 () {62 vars in 1318 bytes} [Tue Jul 12 13:31:27 2022] POST /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f/action => generated 0 bytes in 391 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 12 13:31:28.101485 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-12e2c348-c4ee-4cd4-a696-492ff7bcb0b0 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:31:28.102297 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-12e2c348-c4ee-4cd4-a696-492ff7bcb0b0 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 5d30ed54-909d-491f-a14c-bc4435cfdc6f] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:31:28.111886 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-12e2c348-c4ee-4cd4-a696-492ff7bcb0b0 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:28.113507 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-12e2c348-c4ee-4cd4-a696-492ff7bcb0b0 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:28.115072 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-12e2c348-c4ee-4cd4-a696-492ff7bcb0b0 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:28.115791 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-12e2c348-c4ee-4cd4-a696-492ff7bcb0b0 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:28.313764 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-c1f365b6-157f-4e43-b22d-8060d207ac66 tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d0218137d049d199521460a0211504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6e26c4c8f940e883e9e5548a0318ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:31:28.322205 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-c1f365b6-157f-4e43-b22d-8060d207ac66 tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] 10.222.0.23 "GET /compute/v2.1/servers/5f03387e-b691-45e7-a2b3-f1a66610e66b" status: 200 len: 1465 microversion: 2.1 time: 0.288235 Jul 12 13:31:28.334984 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 187/381] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:31:28 2022] GET /compute/v2.1/servers/5f03387e-b691-45e7-a2b3-f1a66610e66b => generated 1465 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:31:28.385263 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-c853aa0c-6bc6-4e56-bcc9-83f5fe312c00 tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:31:28.386935 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-c853aa0c-6bc6-4e56-bcc9-83f5fe312c00 tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] [instance: 5f03387e-b691-45e7-a2b3-f1a66610e66b] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:31:28.400686 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-c853aa0c-6bc6-4e56-bcc9-83f5fe312c00 tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:28.401693 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-c853aa0c-6bc6-4e56-bcc9-83f5fe312c00 tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:28.403830 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-c853aa0c-6bc6-4e56-bcc9-83f5fe312c00 tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:28.404477 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-c853aa0c-6bc6-4e56-bcc9-83f5fe312c00 tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:28.405066 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-12e2c348-c4ee-4cd4-a696-492ff7bcb0b0 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:31:28.413941 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-12e2c348-c4ee-4cd4-a696-492ff7bcb0b0 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:31:28.415839 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-12e2c348-c4ee-4cd4-a696-492ff7bcb0b0 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:31:28.417914 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-12e2c348-c4ee-4cd4-a696-492ff7bcb0b0 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f" status: 200 len: 1724 microversion: 2.20 time: 0.321436 Jul 12 13:31:28.418995 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 195/382] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:31:28 2022] GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f => generated 1724 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:31:28.447105 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-c853aa0c-6bc6-4e56-bcc9-83f5fe312c00 tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] [instance: 5f03387e-b691-45e7-a2b3-f1a66610e66b] Going to try to terminate instance {{(pid=117987) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 13:31:28.454747 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-8891b754-5d7d-45a6-8b53-f60518946ea9 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:31:28.457396 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-8891b754-5d7d-45a6-8b53-f60518946ea9 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] [instance: c547ded0-7a14-4d94-b2e2-0434481aaa17] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:31:28.467207 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-8891b754-5d7d-45a6-8b53-f60518946ea9 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:28.468017 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-8891b754-5d7d-45a6-8b53-f60518946ea9 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:28.469020 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-8891b754-5d7d-45a6-8b53-f60518946ea9 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:28.469707 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-8891b754-5d7d-45a6-8b53-f60518946ea9 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:28.553832 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-c853aa0c-6bc6-4e56-bcc9-83f5fe312c00 tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] 10.222.0.23 "DELETE /compute/v2.1/servers/5f03387e-b691-45e7-a2b3-f1a66610e66b" status: 204 len: 0 microversion: 2.1 time: 0.175336 Jul 12 13:31:28.554440 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 188/383] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 12 13:31:28 2022] DELETE /compute/v2.1/servers/5f03387e-b691-45e7-a2b3-f1a66610e66b => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 12 13:31:28.564180 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-e232737f-e727-4b34-a6ef-1adda7283fe6 tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:31:28.564812 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-e232737f-e727-4b34-a6ef-1adda7283fe6 tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] [instance: 5f03387e-b691-45e7-a2b3-f1a66610e66b] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:31:28.571434 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-e232737f-e727-4b34-a6ef-1adda7283fe6 tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:28.571883 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-e232737f-e727-4b34-a6ef-1adda7283fe6 tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:28.572663 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-e232737f-e727-4b34-a6ef-1adda7283fe6 tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:28.573803 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-e232737f-e727-4b34-a6ef-1adda7283fe6 tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:28.592795 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-8891b754-5d7d-45a6-8b53-f60518946ea9 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd582e9b7a49c4ea6b9a1d6986d6f4163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86acb815cd62409d9856563af3037d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:31:28.605267 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-8891b754-5d7d-45a6-8b53-f60518946ea9 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] 10.222.0.23 "GET /compute/v2.1/servers/c547ded0-7a14-4d94-b2e2-0434481aaa17" status: 200 len: 1277 microversion: 2.1 time: 0.165956 Jul 12 13:31:28.606115 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 196/384] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:31:28 2022] GET /compute/v2.1/servers/c547ded0-7a14-4d94-b2e2-0434481aaa17 => generated 1277 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:31:28.817693 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-e232737f-e727-4b34-a6ef-1adda7283fe6 tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d0218137d049d199521460a0211504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6e26c4c8f940e883e9e5548a0318ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:31:28.826153 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-e232737f-e727-4b34-a6ef-1adda7283fe6 tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] 10.222.0.23 "GET /compute/v2.1/servers/5f03387e-b691-45e7-a2b3-f1a66610e66b" status: 200 len: 1471 microversion: 2.1 time: 0.266711 Jul 12 13:31:28.826734 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 189/385] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:31:28 2022] GET /compute/v2.1/servers/5f03387e-b691-45e7-a2b3-f1a66610e66b => generated 1471 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:31:29.436963 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-e9329ab0-b6a8-4827-b45c-e74468edfe92 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:31:29.437552 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-e9329ab0-b6a8-4827-b45c-e74468edfe92 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 5d30ed54-909d-491f-a14c-bc4435cfdc6f] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:31:29.444271 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-e9329ab0-b6a8-4827-b45c-e74468edfe92 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:29.444717 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-e9329ab0-b6a8-4827-b45c-e74468edfe92 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:29.445507 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-e9329ab0-b6a8-4827-b45c-e74468edfe92 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:29.445943 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-e9329ab0-b6a8-4827-b45c-e74468edfe92 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:29.595858 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-e9329ab0-b6a8-4827-b45c-e74468edfe92 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:31:29.604555 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-e9329ab0-b6a8-4827-b45c-e74468edfe92 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:31:29.606949 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-e9329ab0-b6a8-4827-b45c-e74468edfe92 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:31:29.608177 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-e9329ab0-b6a8-4827-b45c-e74468edfe92 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f" status: 200 len: 1724 microversion: 2.20 time: 0.175266 Jul 12 13:31:29.608753 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 197/386] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:31:29 2022] GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f => generated 1724 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:31:29.624088 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-c8959bf2-c7f9-4a81-8f6e-078d2083e83b tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:31:29.624721 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-c8959bf2-c7f9-4a81-8f6e-078d2083e83b tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] [instance: c547ded0-7a14-4d94-b2e2-0434481aaa17] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:31:29.631976 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-c8959bf2-c7f9-4a81-8f6e-078d2083e83b tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:29.632429 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-c8959bf2-c7f9-4a81-8f6e-078d2083e83b tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:29.633231 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-c8959bf2-c7f9-4a81-8f6e-078d2083e83b tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:29.633719 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-c8959bf2-c7f9-4a81-8f6e-078d2083e83b tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:29.796651 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-c8959bf2-c7f9-4a81-8f6e-078d2083e83b tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd582e9b7a49c4ea6b9a1d6986d6f4163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86acb815cd62409d9856563af3037d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:31:29.804671 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-c8959bf2-c7f9-4a81-8f6e-078d2083e83b tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] 10.222.0.23 "GET /compute/v2.1/servers/c547ded0-7a14-4d94-b2e2-0434481aaa17" status: 200 len: 1319 microversion: 2.1 time: 0.185744 Jul 12 13:31:29.805239 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 190/387] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:31:29 2022] GET /compute/v2.1/servers/c547ded0-7a14-4d94-b2e2-0434481aaa17 => generated 1319 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:31:29.844080 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-6fc7524f-1a7a-43d3-971b-84c0ef3cdbf0 tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:31:29.844682 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-6fc7524f-1a7a-43d3-971b-84c0ef3cdbf0 tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] [instance: 5f03387e-b691-45e7-a2b3-f1a66610e66b] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:31:29.850799 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-6fc7524f-1a7a-43d3-971b-84c0ef3cdbf0 tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:29.851235 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-6fc7524f-1a7a-43d3-971b-84c0ef3cdbf0 tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:29.851991 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-6fc7524f-1a7a-43d3-971b-84c0ef3cdbf0 tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:29.852420 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-6fc7524f-1a7a-43d3-971b-84c0ef3cdbf0 tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:29.987155 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-6fc7524f-1a7a-43d3-971b-84c0ef3cdbf0 tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d0218137d049d199521460a0211504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6e26c4c8f940e883e9e5548a0318ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:31:29.995569 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-6fc7524f-1a7a-43d3-971b-84c0ef3cdbf0 tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] 10.222.0.23 "GET /compute/v2.1/servers/5f03387e-b691-45e7-a2b3-f1a66610e66b" status: 200 len: 1471 microversion: 2.1 time: 0.154742 Jul 12 13:31:29.996251 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 198/388] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:31:29 2022] GET /compute/v2.1/servers/5f03387e-b691-45e7-a2b3-f1a66610e66b => generated 1471 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:31:30.627030 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-8d2f5801-0805-48a7-a1d9-9674bd2656b8 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:31:30.628655 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-8d2f5801-0805-48a7-a1d9-9674bd2656b8 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 5d30ed54-909d-491f-a14c-bc4435cfdc6f] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:31:30.641344 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-8d2f5801-0805-48a7-a1d9-9674bd2656b8 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:30.641844 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-8d2f5801-0805-48a7-a1d9-9674bd2656b8 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:30.642831 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-8d2f5801-0805-48a7-a1d9-9674bd2656b8 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:30.643256 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-8d2f5801-0805-48a7-a1d9-9674bd2656b8 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:30.690525 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [req-8a32bb69-4799-48a3-b674-9bd5f0ba156b req-775c1314-7e14-4281-afd7-7734722e9390 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c547ded0-7a14-4d94-b2e2-0434481aaa17", "tag": "41de46ac-579d-47d3-a5c1-4f8443756768"}]} {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:31:30.694615 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG dbcounter [-] [117988] Writing DB stats nova_api:SELECT=55 {{(pid=117988) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:31:30.705945 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [req-8a32bb69-4799-48a3-b674-9bd5f0ba156b req-775c1314-7e14-4281-afd7-7734722e9390 service nova] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:30.706383 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [req-8a32bb69-4799-48a3-b674-9bd5f0ba156b req-775c1314-7e14-4281-afd7-7734722e9390 service nova] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:30.720814 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.compute.server_external_events [req-8a32bb69-4799-48a3-b674-9bd5f0ba156b req-775c1314-7e14-4281-afd7-7734722e9390 service nova] Creating event network-changed:41de46ac-579d-47d3-a5c1-4f8443756768 for instance c547ded0-7a14-4d94-b2e2-0434481aaa17 on hv-cinder-82002 Jul 12 13:31:30.726262 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [req-8a32bb69-4799-48a3-b674-9bd5f0ba156b req-775c1314-7e14-4281-afd7-7734722e9390 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039550 Jul 12 13:31:30.726901 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 199/389] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 12 13:31:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 13:31:30.815718 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-8d2f5801-0805-48a7-a1d9-9674bd2656b8 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:31:30.823344 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-f02d8a63-2b3b-471d-a50d-653d9fc4766e tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:31:30.824507 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-f02d8a63-2b3b-471d-a50d-653d9fc4766e tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] [instance: c547ded0-7a14-4d94-b2e2-0434481aaa17] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:31:30.825239 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-8d2f5801-0805-48a7-a1d9-9674bd2656b8 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:31:30.826811 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-8d2f5801-0805-48a7-a1d9-9674bd2656b8 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:31:30.828001 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-8d2f5801-0805-48a7-a1d9-9674bd2656b8 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f" status: 200 len: 1724 microversion: 2.20 time: 0.205024 Jul 12 13:31:30.828565 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 191/390] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:31:30 2022] GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f => generated 1724 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:31:30.831247 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-f02d8a63-2b3b-471d-a50d-653d9fc4766e tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:30.831780 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-f02d8a63-2b3b-471d-a50d-653d9fc4766e tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:30.832458 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-f02d8a63-2b3b-471d-a50d-653d9fc4766e tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:30.832885 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-f02d8a63-2b3b-471d-a50d-653d9fc4766e tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:30.970239 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-f02d8a63-2b3b-471d-a50d-653d9fc4766e tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd582e9b7a49c4ea6b9a1d6986d6f4163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86acb815cd62409d9856563af3037d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:31:30.977714 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-f02d8a63-2b3b-471d-a50d-653d9fc4766e tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] 10.222.0.23 "GET /compute/v2.1/servers/c547ded0-7a14-4d94-b2e2-0434481aaa17" status: 200 len: 1319 microversion: 2.1 time: 0.159245 Jul 12 13:31:30.978293 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 200/391] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:31:30 2022] GET /compute/v2.1/servers/c547ded0-7a14-4d94-b2e2-0434481aaa17 => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:31:31.013760 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-4f73b0f2-4caa-4df3-8736-536eae9e3f04 tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:31:31.014379 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-4f73b0f2-4caa-4df3-8736-536eae9e3f04 tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] [instance: 5f03387e-b691-45e7-a2b3-f1a66610e66b] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:31:31.020485 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-4f73b0f2-4caa-4df3-8736-536eae9e3f04 tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:31.020934 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-4f73b0f2-4caa-4df3-8736-536eae9e3f04 tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:31.021744 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-4f73b0f2-4caa-4df3-8736-536eae9e3f04 tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:31.022180 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-4f73b0f2-4caa-4df3-8736-536eae9e3f04 tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:31.196531 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-4f73b0f2-4caa-4df3-8736-536eae9e3f04 tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d0218137d049d199521460a0211504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6e26c4c8f940e883e9e5548a0318ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:31:31.205788 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-4f73b0f2-4caa-4df3-8736-536eae9e3f04 tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] 10.222.0.23 "GET /compute/v2.1/servers/5f03387e-b691-45e7-a2b3-f1a66610e66b" status: 200 len: 1471 microversion: 2.1 time: 0.196222 Jul 12 13:31:31.206579 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 192/392] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:31:31 2022] GET /compute/v2.1/servers/5f03387e-b691-45e7-a2b3-f1a66610e66b => generated 1471 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:31:31.793817 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-f1a662ba-a139-4e4d-a437-d60ac2486f3a tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:31:31.800451 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-f1a662ba-a139-4e4d-a437-d60ac2486f3a tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:31.800910 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-f1a662ba-a139-4e4d-a437-d60ac2486f3a tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:31.849275 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-b841471a-ed59-4c05-87f9-b790a210588d tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:31:31.850550 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-b841471a-ed59-4c05-87f9-b790a210588d tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 5d30ed54-909d-491f-a14c-bc4435cfdc6f] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:31:31.862259 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-b841471a-ed59-4c05-87f9-b790a210588d tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:31.864953 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-b841471a-ed59-4c05-87f9-b790a210588d tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:31.866866 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-b841471a-ed59-4c05-87f9-b790a210588d tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:31.867555 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-b841471a-ed59-4c05-87f9-b790a210588d tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:31.891198 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-f1a662ba-a139-4e4d-a437-d60ac2486f3a tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] [instance: eeb0b554-cd09-49b5-95f0-22fc7c707944] Going to try to stop instance {{(pid=117988) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 12 13:31:31.983516 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-f1a662ba-a139-4e4d-a437-d60ac2486f3a tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] 10.222.0.23 "POST /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944/action" status: 202 len: 0 microversion: 2.1 time: 0.193972 Jul 12 13:31:31.986198 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 201/393] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 12 13:31:31 2022] POST /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944/action => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 13:31:32.019672 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-55d88b75-0519-4a4e-97ed-e93c56651f86 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:31:32.021119 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-55d88b75-0519-4a4e-97ed-e93c56651f86 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] [instance: eeb0b554-cd09-49b5-95f0-22fc7c707944] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:31:32.037347 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-55d88b75-0519-4a4e-97ed-e93c56651f86 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:32.038385 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-55d88b75-0519-4a4e-97ed-e93c56651f86 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:32.039792 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-55d88b75-0519-4a4e-97ed-e93c56651f86 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:32.040531 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-55d88b75-0519-4a4e-97ed-e93c56651f86 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:32.209854 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-b841471a-ed59-4c05-87f9-b790a210588d tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:31:32.222144 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-b841471a-ed59-4c05-87f9-b790a210588d tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:31:32.223660 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-b841471a-ed59-4c05-87f9-b790a210588d tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:31:32.230547 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-b841471a-ed59-4c05-87f9-b790a210588d tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f" status: 200 len: 1724 microversion: 2.20 time: 0.379467 Jul 12 13:31:32.242106 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 193/394] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:31:31 2022] GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f => generated 1724 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 13:31:32.242106 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-75dd2ef6-e83e-4abc-848b-fc62d709ebcb tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:31:32.242106 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-75dd2ef6-e83e-4abc-848b-fc62d709ebcb tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] [instance: c547ded0-7a14-4d94-b2e2-0434481aaa17] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:31:32.250438 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-75dd2ef6-e83e-4abc-848b-fc62d709ebcb tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:32.251851 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-75dd2ef6-e83e-4abc-848b-fc62d709ebcb tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:32.252692 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-75dd2ef6-e83e-4abc-848b-fc62d709ebcb tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:32.253315 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-75dd2ef6-e83e-4abc-848b-fc62d709ebcb tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:32.259376 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-55d88b75-0519-4a4e-97ed-e93c56651f86 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b710bbdf0c4d58b4f3ee7ef7410c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8fca4ab6ed466a864c5551fea5f7ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:31:32.266957 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-55d88b75-0519-4a4e-97ed-e93c56651f86 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] 10.222.0.23 "GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944" status: 200 len: 1725 microversion: 2.1 time: 0.263973 Jul 12 13:31:32.271765 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 202/395] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:31:32 2022] GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944 => generated 1725 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:31:32.272400 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [req-eeca4c96-3b2b-442d-abfa-e2bd38472559 req-cbb0fd7e-4865-45d5-bbc0-8270feebe7f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f03387e-b691-45e7-a2b3-f1a66610e66b", "name": "network-vif-deleted", "tag": "0986f227-e7ec-4c02-8bb4-98ccbec331f5"}]} {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:31:32.286684 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [req-eeca4c96-3b2b-442d-abfa-e2bd38472559 req-cbb0fd7e-4865-45d5-bbc0-8270feebe7f4 service nova] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:32.287125 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [req-eeca4c96-3b2b-442d-abfa-e2bd38472559 req-cbb0fd7e-4865-45d5-bbc0-8270feebe7f4 service nova] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:32.300055 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.compute.server_external_events [req-eeca4c96-3b2b-442d-abfa-e2bd38472559 req-cbb0fd7e-4865-45d5-bbc0-8270feebe7f4 service nova] Creating event network-vif-deleted:0986f227-e7ec-4c02-8bb4-98ccbec331f5 for instance 5f03387e-b691-45e7-a2b3-f1a66610e66b on hv-cinder-82002 Jul 12 13:31:32.307524 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [req-eeca4c96-3b2b-442d-abfa-e2bd38472559 req-cbb0fd7e-4865-45d5-bbc0-8270feebe7f4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038178 Jul 12 13:31:32.308823 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 203/396] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 12 13:31:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:31:32.315065 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-2b59125b-949a-4e82-9bd5-fede76f364ec tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:31:32.315775 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-2b59125b-949a-4e82-9bd5-fede76f364ec tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] [instance: 5f03387e-b691-45e7-a2b3-f1a66610e66b] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:31:32.322390 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-2b59125b-949a-4e82-9bd5-fede76f364ec tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:32.323503 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-2b59125b-949a-4e82-9bd5-fede76f364ec tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:32.324344 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-2b59125b-949a-4e82-9bd5-fede76f364ec tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:32.324777 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-2b59125b-949a-4e82-9bd5-fede76f364ec tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:32.403602 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-2b59125b-949a-4e82-9bd5-fede76f364ec tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d0218137d049d199521460a0211504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6e26c4c8f940e883e9e5548a0318ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:31:32.411291 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-2b59125b-949a-4e82-9bd5-fede76f364ec tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] 10.222.0.23 "GET /compute/v2.1/servers/5f03387e-b691-45e7-a2b3-f1a66610e66b" status: 200 len: 1300 microversion: 2.1 time: 0.101496 Jul 12 13:31:32.412091 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 204/397] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:31:32 2022] GET /compute/v2.1/servers/5f03387e-b691-45e7-a2b3-f1a66610e66b => generated 1300 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:31:32.462187 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-75dd2ef6-e83e-4abc-848b-fc62d709ebcb tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd582e9b7a49c4ea6b9a1d6986d6f4163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86acb815cd62409d9856563af3037d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:31:32.471470 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-75dd2ef6-e83e-4abc-848b-fc62d709ebcb tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] 10.222.0.23 "GET /compute/v2.1/servers/c547ded0-7a14-4d94-b2e2-0434481aaa17" status: 200 len: 1319 microversion: 2.1 time: 0.237970 Jul 12 13:31:32.472064 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 194/398] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:31:32 2022] GET /compute/v2.1/servers/c547ded0-7a14-4d94-b2e2-0434481aaa17 => generated 1319 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:31:33.249801 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-a6e8fab5-bbfa-441b-be7c-afe33663241a tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:31:33.250483 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-a6e8fab5-bbfa-441b-be7c-afe33663241a tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 5d30ed54-909d-491f-a14c-bc4435cfdc6f] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:31:33.256923 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-a6e8fab5-bbfa-441b-be7c-afe33663241a tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:33.257369 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-a6e8fab5-bbfa-441b-be7c-afe33663241a tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:33.258156 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-a6e8fab5-bbfa-441b-be7c-afe33663241a tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:33.258588 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-a6e8fab5-bbfa-441b-be7c-afe33663241a tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:33.284453 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-8f96af8a-620e-42ba-97d8-c6527e887332 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:31:33.285068 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-8f96af8a-620e-42ba-97d8-c6527e887332 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] [instance: eeb0b554-cd09-49b5-95f0-22fc7c707944] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:31:33.292693 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-8f96af8a-620e-42ba-97d8-c6527e887332 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:33.293396 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-8f96af8a-620e-42ba-97d8-c6527e887332 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:33.294210 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-8f96af8a-620e-42ba-97d8-c6527e887332 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:33.294652 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-8f96af8a-620e-42ba-97d8-c6527e887332 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:33.450035 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-a6e8fab5-bbfa-441b-be7c-afe33663241a tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:31:33.458424 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-a6e8fab5-bbfa-441b-be7c-afe33663241a tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:31:33.459951 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-a6e8fab5-bbfa-441b-be7c-afe33663241a tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:31:33.461122 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-a6e8fab5-bbfa-441b-be7c-afe33663241a tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f" status: 200 len: 1724 microversion: 2.20 time: 0.215479 Jul 12 13:31:33.461724 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 205/399] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:31:33 2022] GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f => generated 1724 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:31:33.467451 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-07f86185-f678-406e-a9e6-22c132f06501 tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:31:33.468078 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-07f86185-f678-406e-a9e6-22c132f06501 tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] [instance: 5f03387e-b691-45e7-a2b3-f1a66610e66b] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:31:33.474179 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-07f86185-f678-406e-a9e6-22c132f06501 tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:33.474634 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-07f86185-f678-406e-a9e6-22c132f06501 tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:33.475411 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-07f86185-f678-406e-a9e6-22c132f06501 tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:33.475843 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-07f86185-f678-406e-a9e6-22c132f06501 tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:33.477199 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-8f96af8a-620e-42ba-97d8-c6527e887332 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b710bbdf0c4d58b4f3ee7ef7410c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8fca4ab6ed466a864c5551fea5f7ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:31:33.486329 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-8f96af8a-620e-42ba-97d8-c6527e887332 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] 10.222.0.23 "GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944" status: 200 len: 1725 microversion: 2.1 time: 0.205595 Jul 12 13:31:33.486914 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 195/400] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:31:33 2022] GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944 => generated 1725 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:31:33.491663 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-a602ebab-70a5-415d-a31f-7457b18bfbdc tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:31:33.491984 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.wsgi [None req-07f86185-f678-406e-a9e6-22c132f06501 tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] HTTP exception thrown: Instance 5f03387e-b691-45e7-a2b3-f1a66610e66b could not be found. Jul 12 13:31:33.492340 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-a602ebab-70a5-415d-a31f-7457b18bfbdc tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] [instance: c547ded0-7a14-4d94-b2e2-0434481aaa17] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:31:33.493713 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-07f86185-f678-406e-a9e6-22c132f06501 tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] Request method failure captured: Jul 12 13:31:33.493713 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: request: GET /compute/v2.1/servers/5f03387e-b691-45e7-a2b3-f1a66610e66b HTTP/1.1 Jul 12 13:31:33.493713 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: Accept: application/json Jul 12 13:31:33.493713 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: Accept-Encoding: identity Jul 12 13:31:33.493713 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: Connection: close Jul 12 13:31:33.493713 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: Content-Length: 0 Jul 12 13:31:33.493713 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: Content-Type: application/json Jul 12 13:31:33.493713 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: Host: 10.222.0.23 Jul 12 13:31:33.493713 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: Openstack-System-Scope: None Jul 12 13:31:33.493713 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: User-Agent: python-urllib3/1.26.9 Jul 12 13:31:33.493713 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Auth-Token: gAAAAABizXeYtmOFXPN7d-ibx88zqQAtJcGRYDVxlXqLEW8HWZswJJqhijYfvj9NAgofnSbGMyFbgZ6srlDBGw0ViRHK8rtNgOAqRLBEym2IOctC5_X1bUHQNIal8e1ZZK1tjsmym4vijzF8VM1jet9lxhgxq8QKo9Vn4XxyVRGt2vpM5xVQZ_g Jul 12 13:31:33.493713 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Domain-Id: None Jul 12 13:31:33.493713 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Domain-Name: None Jul 12 13:31:33.493713 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Identity-Status: Confirmed Jul 12 13:31:33.493713 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Is-Admin-Project: True Jul 12 13:31:33.493713 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Project-Domain-Id: default Jul 12 13:31:33.493713 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Project-Domain-Name: Default Jul 12 13:31:33.493713 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Project-Id: 8e6e26c4c8f940e883e9e5548a0318ca Jul 12 13:31:33.493713 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Project-Name: tempest-VolumesNegativeTest-1436773016 Jul 12 13:31:33.493713 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Role: reader,member Jul 12 13:31:33.493713 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Roles: reader,member Jul 12 13:31:33.495556 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8e6e26c4c8f940e883e9e5548a0318ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8e6e26c4c8f940e883e9e5548a0318ca", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8e6e26c4c8f940e883e9e5548a0318ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8e6e26c4c8f940e883e9e5548a0318ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] Jul 12 13:31:33.495556 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Tenant: tempest-VolumesNegativeTest-1436773016 Jul 12 13:31:33.495556 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Tenant-Id: 8e6e26c4c8f940e883e9e5548a0318ca Jul 12 13:31:33.495556 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Tenant-Name: tempest-VolumesNegativeTest-1436773016 Jul 12 13:31:33.495556 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-User: tempest-VolumesNegativeTest-1436773016-project Jul 12 13:31:33.495556 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-User-Domain-Id: default Jul 12 13:31:33.495556 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-User-Domain-Name: Default Jul 12 13:31:33.495556 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-User-Id: 51d0218137d049d199521460a0211504 Jul 12 13:31:33.495556 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-User-Name: tempest-VolumesNegativeTest-1436773016-project Jul 12 13:31:33.495556 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: method: > Jul 12 13:31:33.495556 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: exception: Instance 5f03387e-b691-45e7-a2b3-f1a66610e66b could not be found. Jul 12 13:31:33.495556 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: action_args: {'id': '5f03387e-b691-45e7-a2b3-f1a66610e66b'} Jul 12 13:31:33.496268 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 13:31:33.496268 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:31:33.496268 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 13:31:33.496268 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 13:31:33.496268 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 13:31:33.496268 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 13:31:33.496268 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 13:31:33.496268 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 13:31:33.496268 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 13:31:33.496268 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 13:31:33.496268 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f03387e-b691-45e7-a2b3-f1a66610e66b could not be found. Jul 12 13:31:33.496268 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi Jul 12 13:31:33.496268 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:31:33.496268 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi Jul 12 13:31:33.496268 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:31:33.496268 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:31:33.496268 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:31:33.496268 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 13:31:33.496268 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 13:31:33.496268 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 13:31:33.508255 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:31:33.508255 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 13:31:33.508255 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 13:31:33.508255 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 13:31:33.508255 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 13:31:33.508255 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 13:31:33.508255 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 13:31:33.508255 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f03387e-b691-45e7-a2b3-f1a66610e66b could not be found. Jul 12 13:31:33.508255 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi Jul 12 13:31:33.508255 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:31:33.508255 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi Jul 12 13:31:33.508255 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:31:33.508255 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:31:33.508255 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:31:33.508255 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 13:31:33.508255 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 13:31:33.508255 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f03387e-b691-45e7-a2b3-f1a66610e66b could not be found. Jul 12 13:31:33.508255 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi Jul 12 13:31:33.513498 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-07f86185-f678-406e-a9e6-22c132f06501 tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] Returning 404 to user: Instance 5f03387e-b691-45e7-a2b3-f1a66610e66b could not be found. {{(pid=117988) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 13:31:33.513498 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-07f86185-f678-406e-a9e6-22c132f06501 tempest-VolumesNegativeTest-1436773016 tempest-VolumesNegativeTest-1436773016-project] 10.222.0.23 "GET /compute/v2.1/servers/5f03387e-b691-45e7-a2b3-f1a66610e66b" status: 404 len: 111 microversion: 2.1 time: 0.033482 Jul 12 13:31:33.513498 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 206/401] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:31:33 2022] GET /compute/v2.1/servers/5f03387e-b691-45e7-a2b3-f1a66610e66b => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 13:31:33.513755 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-a602ebab-70a5-415d-a31f-7457b18bfbdc tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:33.513755 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-a602ebab-70a5-415d-a31f-7457b18bfbdc tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:33.513755 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-a602ebab-70a5-415d-a31f-7457b18bfbdc tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:33.513755 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-a602ebab-70a5-415d-a31f-7457b18bfbdc tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:33.645898 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-a602ebab-70a5-415d-a31f-7457b18bfbdc tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd582e9b7a49c4ea6b9a1d6986d6f4163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86acb815cd62409d9856563af3037d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:31:33.655398 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-a602ebab-70a5-415d-a31f-7457b18bfbdc tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] 10.222.0.23 "GET /compute/v2.1/servers/c547ded0-7a14-4d94-b2e2-0434481aaa17" status: 200 len: 1319 microversion: 2.1 time: 0.167407 Jul 12 13:31:33.656253 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 196/402] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:31:33 2022] GET /compute/v2.1/servers/c547ded0-7a14-4d94-b2e2-0434481aaa17 => generated 1319 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:31:34.480136 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-88c4005b-0ff0-45ee-b7bf-04122e0453dd tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:31:34.480794 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-88c4005b-0ff0-45ee-b7bf-04122e0453dd tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 5d30ed54-909d-491f-a14c-bc4435cfdc6f] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:31:34.487557 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-88c4005b-0ff0-45ee-b7bf-04122e0453dd tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:34.488025 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-88c4005b-0ff0-45ee-b7bf-04122e0453dd tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:34.488775 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-88c4005b-0ff0-45ee-b7bf-04122e0453dd tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:34.489205 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-88c4005b-0ff0-45ee-b7bf-04122e0453dd tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:34.508996 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-3b09d497-f1ae-44df-ad6e-8c3df135c31b tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:31:34.509802 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-3b09d497-f1ae-44df-ad6e-8c3df135c31b tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] [instance: eeb0b554-cd09-49b5-95f0-22fc7c707944] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:31:34.517479 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-3b09d497-f1ae-44df-ad6e-8c3df135c31b tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:34.517929 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-3b09d497-f1ae-44df-ad6e-8c3df135c31b tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:34.518781 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-3b09d497-f1ae-44df-ad6e-8c3df135c31b tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:34.519141 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-3b09d497-f1ae-44df-ad6e-8c3df135c31b tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:34.943312 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG dbcounter [-] [117987] Writing DB stats nova_cell0:SELECT=2 {{(pid=117987) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:31:34.965045 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-88c4005b-0ff0-45ee-b7bf-04122e0453dd tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:31:34.969968 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-3b09d497-f1ae-44df-ad6e-8c3df135c31b tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b710bbdf0c4d58b4f3ee7ef7410c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8fca4ab6ed466a864c5551fea5f7ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:31:34.972295 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG dbcounter [-] [117987] Writing DB stats nova_cell0:SELECT=6 {{(pid=117987) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:31:34.975028 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-88c4005b-0ff0-45ee-b7bf-04122e0453dd tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:31:34.976723 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-88c4005b-0ff0-45ee-b7bf-04122e0453dd tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:31:34.977910 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-88c4005b-0ff0-45ee-b7bf-04122e0453dd tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f" status: 200 len: 1724 microversion: 2.20 time: 0.501901 Jul 12 13:31:34.978462 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 207/403] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:31:34 2022] GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f => generated 1724 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:31:34.980971 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-3b09d497-f1ae-44df-ad6e-8c3df135c31b tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] 10.222.0.23 "GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944" status: 200 len: 1725 microversion: 2.1 time: 0.476623 Jul 12 13:31:34.981578 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 197/404] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:31:34 2022] GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944 => generated 1725 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:31:34.983760 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-8b3e6f8d-6fdd-4d1a-9013-7a1501ad39e2 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:31:34.984364 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-8b3e6f8d-6fdd-4d1a-9013-7a1501ad39e2 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] [instance: c547ded0-7a14-4d94-b2e2-0434481aaa17] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:31:34.990442 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-8b3e6f8d-6fdd-4d1a-9013-7a1501ad39e2 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:34.990883 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-8b3e6f8d-6fdd-4d1a-9013-7a1501ad39e2 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:34.991674 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-8b3e6f8d-6fdd-4d1a-9013-7a1501ad39e2 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:34.992178 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-8b3e6f8d-6fdd-4d1a-9013-7a1501ad39e2 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:35.143764 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-8b3e6f8d-6fdd-4d1a-9013-7a1501ad39e2 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd582e9b7a49c4ea6b9a1d6986d6f4163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86acb815cd62409d9856563af3037d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:31:35.152243 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-8b3e6f8d-6fdd-4d1a-9013-7a1501ad39e2 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] 10.222.0.23 "GET /compute/v2.1/servers/c547ded0-7a14-4d94-b2e2-0434481aaa17" status: 200 len: 1319 microversion: 2.1 time: 0.171653 Jul 12 13:31:35.152928 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 208/405] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:31:34 2022] GET /compute/v2.1/servers/c547ded0-7a14-4d94-b2e2-0434481aaa17 => generated 1319 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:31:35.998599 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-54987cbe-9610-49cf-b2d8-0bdd6fee5d3b tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:31:35.999406 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-54987cbe-9610-49cf-b2d8-0bdd6fee5d3b tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 5d30ed54-909d-491f-a14c-bc4435cfdc6f] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:31:36.000214 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-647a011a-b481-47d7-ba04-79181d52b828 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:31:36.000967 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-647a011a-b481-47d7-ba04-79181d52b828 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] [instance: eeb0b554-cd09-49b5-95f0-22fc7c707944] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:31:36.003537 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG dbcounter [-] [117988] Writing DB stats nova_cell0:SELECT=2 {{(pid=117988) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:31:36.007070 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-54987cbe-9610-49cf-b2d8-0bdd6fee5d3b tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:36.007523 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-54987cbe-9610-49cf-b2d8-0bdd6fee5d3b tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:36.008289 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-54987cbe-9610-49cf-b2d8-0bdd6fee5d3b tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:36.008895 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-54987cbe-9610-49cf-b2d8-0bdd6fee5d3b tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:36.012629 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-647a011a-b481-47d7-ba04-79181d52b828 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:36.013176 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-647a011a-b481-47d7-ba04-79181d52b828 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:36.014524 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-647a011a-b481-47d7-ba04-79181d52b828 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:36.014524 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-647a011a-b481-47d7-ba04-79181d52b828 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:36.034724 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG dbcounter [-] [117988] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117988) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:31:36.255396 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-647a011a-b481-47d7-ba04-79181d52b828 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b710bbdf0c4d58b4f3ee7ef7410c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8fca4ab6ed466a864c5551fea5f7ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:31:36.261860 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-54987cbe-9610-49cf-b2d8-0bdd6fee5d3b tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:31:36.265961 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-647a011a-b481-47d7-ba04-79181d52b828 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] 10.222.0.23 "GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944" status: 200 len: 1725 microversion: 2.1 time: 0.270251 Jul 12 13:31:36.266944 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 209/406] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:31:35 2022] GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944 => generated 1725 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:31:36.274121 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-b1876604-b3b0-4e11-b2f1-7690de446895 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:31:36.274121 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-b1876604-b3b0-4e11-b2f1-7690de446895 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] [instance: c547ded0-7a14-4d94-b2e2-0434481aaa17] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:31:36.275233 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-54987cbe-9610-49cf-b2d8-0bdd6fee5d3b tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:31:36.277780 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-54987cbe-9610-49cf-b2d8-0bdd6fee5d3b tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:31:36.279391 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-54987cbe-9610-49cf-b2d8-0bdd6fee5d3b tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f" status: 200 len: 1724 microversion: 2.20 time: 0.285922 Jul 12 13:31:36.279971 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 198/407] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:31:35 2022] GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f => generated 1724 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:31:36.281343 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-b1876604-b3b0-4e11-b2f1-7690de446895 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:36.282249 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-b1876604-b3b0-4e11-b2f1-7690de446895 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:36.283844 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-b1876604-b3b0-4e11-b2f1-7690de446895 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:36.284416 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-b1876604-b3b0-4e11-b2f1-7690de446895 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:36.440357 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-b1876604-b3b0-4e11-b2f1-7690de446895 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd582e9b7a49c4ea6b9a1d6986d6f4163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86acb815cd62409d9856563af3037d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:31:36.448817 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-b1876604-b3b0-4e11-b2f1-7690de446895 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] 10.222.0.23 "GET /compute/v2.1/servers/c547ded0-7a14-4d94-b2e2-0434481aaa17" status: 200 len: 1319 microversion: 2.1 time: 0.180216 Jul 12 13:31:36.449632 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 210/408] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:31:36 2022] GET /compute/v2.1/servers/c547ded0-7a14-4d94-b2e2-0434481aaa17 => generated 1319 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:31:37.284223 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-d4b5caf0-4f92-4f62-b96b-99c5c7f71f4f tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:31:37.284770 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-d4b5caf0-4f92-4f62-b96b-99c5c7f71f4f tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] [instance: eeb0b554-cd09-49b5-95f0-22fc7c707944] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:31:37.287069 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG dbcounter [-] [117987] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=117987) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:31:37.298489 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-c164a550-abf1-4e12-9ec9-3247b6848033 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:31:37.299104 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-c164a550-abf1-4e12-9ec9-3247b6848033 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 5d30ed54-909d-491f-a14c-bc4435cfdc6f] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:31:37.299998 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-d4b5caf0-4f92-4f62-b96b-99c5c7f71f4f tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:37.300457 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-d4b5caf0-4f92-4f62-b96b-99c5c7f71f4f tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:37.301282 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-d4b5caf0-4f92-4f62-b96b-99c5c7f71f4f tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:37.301768 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-d4b5caf0-4f92-4f62-b96b-99c5c7f71f4f tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:37.306038 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-c164a550-abf1-4e12-9ec9-3247b6848033 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:37.306658 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-c164a550-abf1-4e12-9ec9-3247b6848033 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:37.308600 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-c164a550-abf1-4e12-9ec9-3247b6848033 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:37.309058 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-c164a550-abf1-4e12-9ec9-3247b6848033 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:37.508099 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-d4b5caf0-4f92-4f62-b96b-99c5c7f71f4f tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b710bbdf0c4d58b4f3ee7ef7410c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8fca4ab6ed466a864c5551fea5f7ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:31:37.513885 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-c164a550-abf1-4e12-9ec9-3247b6848033 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:31:37.518478 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-d4b5caf0-4f92-4f62-b96b-99c5c7f71f4f tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] 10.222.0.23 "GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944" status: 200 len: 1725 microversion: 2.1 time: 0.237007 Jul 12 13:31:37.519336 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 199/409] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:31:37 2022] GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944 => generated 1725 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:31:37.527951 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-8935cabc-0faf-493a-9bc6-715d293f9c1e tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:31:37.528705 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-8935cabc-0faf-493a-9bc6-715d293f9c1e tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] [instance: c547ded0-7a14-4d94-b2e2-0434481aaa17] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:31:37.535103 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-c164a550-abf1-4e12-9ec9-3247b6848033 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:31:37.535379 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-8935cabc-0faf-493a-9bc6-715d293f9c1e tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:37.535515 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-8935cabc-0faf-493a-9bc6-715d293f9c1e tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:37.536295 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-8935cabc-0faf-493a-9bc6-715d293f9c1e tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:37.536562 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-c164a550-abf1-4e12-9ec9-3247b6848033 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:31:37.536732 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-8935cabc-0faf-493a-9bc6-715d293f9c1e tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:37.538251 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-c164a550-abf1-4e12-9ec9-3247b6848033 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f" status: 200 len: 1724 microversion: 2.20 time: 0.243542 Jul 12 13:31:37.539467 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 211/410] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:31:37 2022] GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f => generated 1724 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 13:31:37.683971 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-8935cabc-0faf-493a-9bc6-715d293f9c1e tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd582e9b7a49c4ea6b9a1d6986d6f4163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86acb815cd62409d9856563af3037d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:31:37.691990 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-8935cabc-0faf-493a-9bc6-715d293f9c1e tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] 10.222.0.23 "GET /compute/v2.1/servers/c547ded0-7a14-4d94-b2e2-0434481aaa17" status: 200 len: 1319 microversion: 2.1 time: 0.171046 Jul 12 13:31:37.692577 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 200/411] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:31:37 2022] GET /compute/v2.1/servers/c547ded0-7a14-4d94-b2e2-0434481aaa17 => generated 1319 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:31:38.538171 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-4d85239c-ced9-4b8c-8f4c-dc0a218ee8ce tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:31:38.538785 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-4d85239c-ced9-4b8c-8f4c-dc0a218ee8ce tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] [instance: eeb0b554-cd09-49b5-95f0-22fc7c707944] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:31:38.546435 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-4d85239c-ced9-4b8c-8f4c-dc0a218ee8ce tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:38.546884 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-4d85239c-ced9-4b8c-8f4c-dc0a218ee8ce tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:38.547664 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-4d85239c-ced9-4b8c-8f4c-dc0a218ee8ce tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:38.548094 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-4d85239c-ced9-4b8c-8f4c-dc0a218ee8ce tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:38.560867 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-fa8f0969-1031-4bdb-a876-9fc2b576d96c tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:31:38.561580 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-fa8f0969-1031-4bdb-a876-9fc2b576d96c tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 5d30ed54-909d-491f-a14c-bc4435cfdc6f] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:31:38.569262 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-fa8f0969-1031-4bdb-a876-9fc2b576d96c tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:38.569752 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-fa8f0969-1031-4bdb-a876-9fc2b576d96c tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:38.570527 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-fa8f0969-1031-4bdb-a876-9fc2b576d96c tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:38.571154 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-fa8f0969-1031-4bdb-a876-9fc2b576d96c tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:38.776798 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-fa8f0969-1031-4bdb-a876-9fc2b576d96c tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:31:38.777094 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-4d85239c-ced9-4b8c-8f4c-dc0a218ee8ce tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b710bbdf0c4d58b4f3ee7ef7410c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8fca4ab6ed466a864c5551fea5f7ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:31:38.780562 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG dbcounter [-] [117987] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117987) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:31:38.786932 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-fa8f0969-1031-4bdb-a876-9fc2b576d96c tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:31:38.788555 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-4d85239c-ced9-4b8c-8f4c-dc0a218ee8ce tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] 10.222.0.23 "GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944" status: 200 len: 1725 microversion: 2.1 time: 0.254132 Jul 12 13:31:38.788702 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-fa8f0969-1031-4bdb-a876-9fc2b576d96c tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:31:38.789139 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 212/412] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:31:38 2022] GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944 => generated 1725 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:31:38.789783 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-fa8f0969-1031-4bdb-a876-9fc2b576d96c tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f" status: 200 len: 1724 microversion: 2.20 time: 0.233567 Jul 12 13:31:38.790335 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 201/413] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:31:38 2022] GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f => generated 1724 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 13:31:38.797206 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-aedfa046-bd38-461e-85e3-653e2d3e0a3e tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:31:38.798303 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-aedfa046-bd38-461e-85e3-653e2d3e0a3e tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] [instance: c547ded0-7a14-4d94-b2e2-0434481aaa17] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:31:38.804840 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-aedfa046-bd38-461e-85e3-653e2d3e0a3e tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:38.805287 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-aedfa046-bd38-461e-85e3-653e2d3e0a3e tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:38.806179 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-aedfa046-bd38-461e-85e3-653e2d3e0a3e tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:38.806664 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-aedfa046-bd38-461e-85e3-653e2d3e0a3e tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:38.952258 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-aedfa046-bd38-461e-85e3-653e2d3e0a3e tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd582e9b7a49c4ea6b9a1d6986d6f4163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86acb815cd62409d9856563af3037d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:31:38.960011 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-aedfa046-bd38-461e-85e3-653e2d3e0a3e tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] 10.222.0.23 "GET /compute/v2.1/servers/c547ded0-7a14-4d94-b2e2-0434481aaa17" status: 200 len: 1319 microversion: 2.1 time: 0.169597 Jul 12 13:31:38.960597 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 213/414] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:31:38 2022] GET /compute/v2.1/servers/c547ded0-7a14-4d94-b2e2-0434481aaa17 => generated 1319 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:31:39.226929 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [req-2848dd40-330c-4d2b-b3bb-af6cde9c71fb req-4520afa8-e931-441f-b947-14c8a4cff590 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c547ded0-7a14-4d94-b2e2-0434481aaa17", "name": "network-vif-plugged", "status": "completed", "tag": "41de46ac-579d-47d3-a5c1-4f8443756768"}]} {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:31:39.241733 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [req-2848dd40-330c-4d2b-b3bb-af6cde9c71fb req-4520afa8-e931-441f-b947-14c8a4cff590 service nova] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:39.242449 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [req-2848dd40-330c-4d2b-b3bb-af6cde9c71fb req-4520afa8-e931-441f-b947-14c8a4cff590 service nova] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:39.268044 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.compute.server_external_events [req-2848dd40-330c-4d2b-b3bb-af6cde9c71fb req-4520afa8-e931-441f-b947-14c8a4cff590 service nova] Creating event network-vif-plugged:41de46ac-579d-47d3-a5c1-4f8443756768 for instance c547ded0-7a14-4d94-b2e2-0434481aaa17 on hv-cinder-82002 Jul 12 13:31:39.274816 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [req-2848dd40-330c-4d2b-b3bb-af6cde9c71fb req-4520afa8-e931-441f-b947-14c8a4cff590 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051822 Jul 12 13:31:39.277024 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 202/415] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 12 13:31:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:31:39.807717 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-a1cd3d44-eb75-460e-8031-8cd72082b21e tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:31:39.808353 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-a1cd3d44-eb75-460e-8031-8cd72082b21e tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] [instance: eeb0b554-cd09-49b5-95f0-22fc7c707944] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:31:39.809205 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-d69778a4-b0bb-4b97-9d41-3df419002c98 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:31:39.809941 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-d69778a4-b0bb-4b97-9d41-3df419002c98 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 5d30ed54-909d-491f-a14c-bc4435cfdc6f] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:31:39.815292 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-a1cd3d44-eb75-460e-8031-8cd72082b21e tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:39.815732 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-a1cd3d44-eb75-460e-8031-8cd72082b21e tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:39.816490 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-a1cd3d44-eb75-460e-8031-8cd72082b21e tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:39.816890 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-d69778a4-b0bb-4b97-9d41-3df419002c98 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:39.817009 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-a1cd3d44-eb75-460e-8031-8cd72082b21e tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:39.817349 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-d69778a4-b0bb-4b97-9d41-3df419002c98 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:39.818148 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-d69778a4-b0bb-4b97-9d41-3df419002c98 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:39.818585 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-d69778a4-b0bb-4b97-9d41-3df419002c98 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:40.008984 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-d69778a4-b0bb-4b97-9d41-3df419002c98 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:31:40.016962 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-a1cd3d44-eb75-460e-8031-8cd72082b21e tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b710bbdf0c4d58b4f3ee7ef7410c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8fca4ab6ed466a864c5551fea5f7ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:31:40.017809 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-d69778a4-b0bb-4b97-9d41-3df419002c98 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:31:40.019331 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-d69778a4-b0bb-4b97-9d41-3df419002c98 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:31:40.020505 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-d69778a4-b0bb-4b97-9d41-3df419002c98 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f" status: 200 len: 1724 microversion: 2.20 time: 0.216081 Jul 12 13:31:40.021070 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 203/416] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:31:39 2022] GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f => generated 1724 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 13:31:40.025240 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-a1cd3d44-eb75-460e-8031-8cd72082b21e tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] 10.222.0.23 "GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944" status: 200 len: 1725 microversion: 2.1 time: 0.221298 Jul 12 13:31:40.026505 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 214/417] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:31:39 2022] GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944 => generated 1725 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:31:40.034592 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-5225a814-dbc5-4987-8bc7-a9b48f850e96 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:31:40.034592 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-5225a814-dbc5-4987-8bc7-a9b48f850e96 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] [instance: c547ded0-7a14-4d94-b2e2-0434481aaa17] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:31:40.034592 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-5225a814-dbc5-4987-8bc7-a9b48f850e96 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:40.034592 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-5225a814-dbc5-4987-8bc7-a9b48f850e96 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:40.034961 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-5225a814-dbc5-4987-8bc7-a9b48f850e96 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:40.034961 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-5225a814-dbc5-4987-8bc7-a9b48f850e96 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:40.169702 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-5225a814-dbc5-4987-8bc7-a9b48f850e96 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd582e9b7a49c4ea6b9a1d6986d6f4163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86acb815cd62409d9856563af3037d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:31:40.177246 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-5225a814-dbc5-4987-8bc7-a9b48f850e96 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] 10.222.0.23 "GET /compute/v2.1/servers/c547ded0-7a14-4d94-b2e2-0434481aaa17" status: 200 len: 1319 microversion: 2.1 time: 0.154961 Jul 12 13:31:40.177849 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 204/418] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:31:40 2022] GET /compute/v2.1/servers/c547ded0-7a14-4d94-b2e2-0434481aaa17 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:31:41.039529 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-7588e407-cbf2-4565-899b-d994b29c015c tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:31:41.040410 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-7588e407-cbf2-4565-899b-d994b29c015c tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 5d30ed54-909d-491f-a14c-bc4435cfdc6f] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:31:41.043438 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-0c0d5cd2-3ae1-410f-ae82-745c254b8ab2 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:31:41.044114 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-0c0d5cd2-3ae1-410f-ae82-745c254b8ab2 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] [instance: eeb0b554-cd09-49b5-95f0-22fc7c707944] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:31:41.046955 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-7588e407-cbf2-4565-899b-d994b29c015c tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:41.047408 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-7588e407-cbf2-4565-899b-d994b29c015c tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:41.048190 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-7588e407-cbf2-4565-899b-d994b29c015c tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:41.048613 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-7588e407-cbf2-4565-899b-d994b29c015c tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:41.050883 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-0c0d5cd2-3ae1-410f-ae82-745c254b8ab2 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:41.051333 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-0c0d5cd2-3ae1-410f-ae82-745c254b8ab2 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:41.052128 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-0c0d5cd2-3ae1-410f-ae82-745c254b8ab2 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:41.052561 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-0c0d5cd2-3ae1-410f-ae82-745c254b8ab2 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:41.261811 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-0c0d5cd2-3ae1-410f-ae82-745c254b8ab2 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b710bbdf0c4d58b4f3ee7ef7410c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8fca4ab6ed466a864c5551fea5f7ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:31:41.265555 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-7588e407-cbf2-4565-899b-d994b29c015c tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:31:41.270084 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-0c0d5cd2-3ae1-410f-ae82-745c254b8ab2 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] 10.222.0.23 "GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944" status: 200 len: 1725 microversion: 2.1 time: 0.231024 Jul 12 13:31:41.270665 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 205/419] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:31:41 2022] GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944 => generated 1725 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:31:41.274187 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-7588e407-cbf2-4565-899b-d994b29c015c tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:31:41.275168 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-fa52ca7c-b5cc-4d14-839e-e67ab81a41a9 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:31:41.275757 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-7588e407-cbf2-4565-899b-d994b29c015c tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:31:41.275865 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-fa52ca7c-b5cc-4d14-839e-e67ab81a41a9 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] [instance: c547ded0-7a14-4d94-b2e2-0434481aaa17] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:31:41.277707 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-7588e407-cbf2-4565-899b-d994b29c015c tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f" status: 200 len: 1724 microversion: 2.20 time: 0.242085 Jul 12 13:31:41.278532 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 215/420] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:31:41 2022] GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f => generated 1724 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:31:41.282191 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-fa52ca7c-b5cc-4d14-839e-e67ab81a41a9 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:41.282643 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-fa52ca7c-b5cc-4d14-839e-e67ab81a41a9 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:41.283416 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-fa52ca7c-b5cc-4d14-839e-e67ab81a41a9 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:41.283855 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-fa52ca7c-b5cc-4d14-839e-e67ab81a41a9 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:41.422177 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-fa52ca7c-b5cc-4d14-839e-e67ab81a41a9 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd582e9b7a49c4ea6b9a1d6986d6f4163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86acb815cd62409d9856563af3037d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:31:41.431413 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-fa52ca7c-b5cc-4d14-839e-e67ab81a41a9 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] 10.222.0.23 "GET /compute/v2.1/servers/c547ded0-7a14-4d94-b2e2-0434481aaa17" status: 200 len: 1319 microversion: 2.1 time: 0.159564 Jul 12 13:31:41.432688 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 206/421] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:31:41 2022] GET /compute/v2.1/servers/c547ded0-7a14-4d94-b2e2-0434481aaa17 => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:31:42.296219 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-81384037-e6be-4f4d-ae80-04b76f7b7bbf tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:31:42.296885 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-81384037-e6be-4f4d-ae80-04b76f7b7bbf tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 5d30ed54-909d-491f-a14c-bc4435cfdc6f] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:31:42.297091 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-46a94d70-5380-4a3a-b35d-505d0d427b64 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:31:42.297751 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-46a94d70-5380-4a3a-b35d-505d0d427b64 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] [instance: eeb0b554-cd09-49b5-95f0-22fc7c707944] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:31:42.303632 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-81384037-e6be-4f4d-ae80-04b76f7b7bbf tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:42.304085 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-81384037-e6be-4f4d-ae80-04b76f7b7bbf tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:42.304392 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-46a94d70-5380-4a3a-b35d-505d0d427b64 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:42.304840 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-46a94d70-5380-4a3a-b35d-505d0d427b64 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:42.304955 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-81384037-e6be-4f4d-ae80-04b76f7b7bbf tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:42.305440 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-81384037-e6be-4f4d-ae80-04b76f7b7bbf tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:42.305638 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-46a94d70-5380-4a3a-b35d-505d0d427b64 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:42.306068 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-46a94d70-5380-4a3a-b35d-505d0d427b64 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:42.514633 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-81384037-e6be-4f4d-ae80-04b76f7b7bbf tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:31:42.518596 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-46a94d70-5380-4a3a-b35d-505d0d427b64 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b710bbdf0c4d58b4f3ee7ef7410c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8fca4ab6ed466a864c5551fea5f7ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:31:42.522922 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-81384037-e6be-4f4d-ae80-04b76f7b7bbf tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:31:42.524411 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-81384037-e6be-4f4d-ae80-04b76f7b7bbf tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:31:42.525596 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-81384037-e6be-4f4d-ae80-04b76f7b7bbf tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f" status: 200 len: 1724 microversion: 2.20 time: 0.233985 Jul 12 13:31:42.526284 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 216/422] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:31:42 2022] GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f => generated 1724 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:31:42.526954 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-46a94d70-5380-4a3a-b35d-505d0d427b64 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] 10.222.0.23 "GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944" status: 200 len: 1725 microversion: 2.1 time: 0.233869 Jul 12 13:31:42.527548 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 207/423] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:31:42 2022] GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944 => generated 1725 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:31:42.531210 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-3593d9dd-757f-4b1d-a33f-26c36f28a80d tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:31:42.531811 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-3593d9dd-757f-4b1d-a33f-26c36f28a80d tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] [instance: c547ded0-7a14-4d94-b2e2-0434481aaa17] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:31:42.537984 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-3593d9dd-757f-4b1d-a33f-26c36f28a80d tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:42.538429 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-3593d9dd-757f-4b1d-a33f-26c36f28a80d tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:42.539185 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-3593d9dd-757f-4b1d-a33f-26c36f28a80d tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:42.539619 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-3593d9dd-757f-4b1d-a33f-26c36f28a80d tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:42.674587 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-3593d9dd-757f-4b1d-a33f-26c36f28a80d tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd582e9b7a49c4ea6b9a1d6986d6f4163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86acb815cd62409d9856563af3037d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:31:42.682228 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-3593d9dd-757f-4b1d-a33f-26c36f28a80d tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] 10.222.0.23 "GET /compute/v2.1/servers/c547ded0-7a14-4d94-b2e2-0434481aaa17" status: 200 len: 1319 microversion: 2.1 time: 0.154901 Jul 12 13:31:42.682796 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 217/424] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:31:42 2022] GET /compute/v2.1/servers/c547ded0-7a14-4d94-b2e2-0434481aaa17 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:31:43.545827 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-a4dc4804-a8f5-4b35-9be8-84eeacdb9c04 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:31:43.546706 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-26aad347-bd89-4131-b8c0-b705fdd59f6b tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:31:43.547208 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-a4dc4804-a8f5-4b35-9be8-84eeacdb9c04 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 5d30ed54-909d-491f-a14c-bc4435cfdc6f] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:31:43.547358 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-26aad347-bd89-4131-b8c0-b705fdd59f6b tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] [instance: eeb0b554-cd09-49b5-95f0-22fc7c707944] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:31:43.553622 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-a4dc4804-a8f5-4b35-9be8-84eeacdb9c04 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:43.554078 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-a4dc4804-a8f5-4b35-9be8-84eeacdb9c04 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:43.554229 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-26aad347-bd89-4131-b8c0-b705fdd59f6b tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:43.554620 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-26aad347-bd89-4131-b8c0-b705fdd59f6b tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:43.554869 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-a4dc4804-a8f5-4b35-9be8-84eeacdb9c04 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:43.555315 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-a4dc4804-a8f5-4b35-9be8-84eeacdb9c04 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:43.555491 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-26aad347-bd89-4131-b8c0-b705fdd59f6b tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:43.555815 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-26aad347-bd89-4131-b8c0-b705fdd59f6b tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:43.758614 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-26aad347-bd89-4131-b8c0-b705fdd59f6b tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b710bbdf0c4d58b4f3ee7ef7410c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8fca4ab6ed466a864c5551fea5f7ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:31:43.768014 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-26aad347-bd89-4131-b8c0-b705fdd59f6b tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] 10.222.0.23 "GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944" status: 200 len: 1725 microversion: 2.1 time: 0.227416 Jul 12 13:31:43.768612 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 208/425] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:31:43 2022] GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944 => generated 1725 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:31:43.771994 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-a4dc4804-a8f5-4b35-9be8-84eeacdb9c04 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:31:43.773240 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-47c21598-f7c6-4241-bc05-922ed4d0ea9c tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:31:43.773973 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-47c21598-f7c6-4241-bc05-922ed4d0ea9c tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] [instance: c547ded0-7a14-4d94-b2e2-0434481aaa17] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:31:43.780636 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-47c21598-f7c6-4241-bc05-922ed4d0ea9c tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:43.780968 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-a4dc4804-a8f5-4b35-9be8-84eeacdb9c04 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:31:43.781114 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-47c21598-f7c6-4241-bc05-922ed4d0ea9c tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:43.781866 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-47c21598-f7c6-4241-bc05-922ed4d0ea9c tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:43.782300 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-47c21598-f7c6-4241-bc05-922ed4d0ea9c tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:43.782511 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-a4dc4804-a8f5-4b35-9be8-84eeacdb9c04 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:31:43.783678 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-a4dc4804-a8f5-4b35-9be8-84eeacdb9c04 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f" status: 200 len: 1724 microversion: 2.20 time: 0.243013 Jul 12 13:31:43.784240 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 218/426] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:31:43 2022] GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f => generated 1724 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 13:31:43.920168 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-47c21598-f7c6-4241-bc05-922ed4d0ea9c tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd582e9b7a49c4ea6b9a1d6986d6f4163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86acb815cd62409d9856563af3037d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:31:43.927765 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-47c21598-f7c6-4241-bc05-922ed4d0ea9c tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] 10.222.0.23 "GET /compute/v2.1/servers/c547ded0-7a14-4d94-b2e2-0434481aaa17" status: 200 len: 1319 microversion: 2.1 time: 0.158114 Jul 12 13:31:43.928342 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 209/427] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:31:43 2022] GET /compute/v2.1/servers/c547ded0-7a14-4d94-b2e2-0434481aaa17 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:31:44.786173 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-61ce3d9d-f41f-4f53-ae7f-5e524ac31c29 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:31:44.786817 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-61ce3d9d-f41f-4f53-ae7f-5e524ac31c29 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] [instance: eeb0b554-cd09-49b5-95f0-22fc7c707944] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:31:44.794973 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-61ce3d9d-f41f-4f53-ae7f-5e524ac31c29 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:44.795422 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-61ce3d9d-f41f-4f53-ae7f-5e524ac31c29 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:44.796205 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-61ce3d9d-f41f-4f53-ae7f-5e524ac31c29 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:44.796641 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-61ce3d9d-f41f-4f53-ae7f-5e524ac31c29 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:44.804503 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-06be5101-dcb5-41bf-a0ed-c377acf5530f tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:31:44.805507 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-06be5101-dcb5-41bf-a0ed-c377acf5530f tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 5d30ed54-909d-491f-a14c-bc4435cfdc6f] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:31:44.814249 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-06be5101-dcb5-41bf-a0ed-c377acf5530f tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:44.814706 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-06be5101-dcb5-41bf-a0ed-c377acf5530f tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:44.815494 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-06be5101-dcb5-41bf-a0ed-c377acf5530f tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:44.815927 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-06be5101-dcb5-41bf-a0ed-c377acf5530f tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:44.993801 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-61ce3d9d-f41f-4f53-ae7f-5e524ac31c29 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b710bbdf0c4d58b4f3ee7ef7410c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8fca4ab6ed466a864c5551fea5f7ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:31:45.003234 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-61ce3d9d-f41f-4f53-ae7f-5e524ac31c29 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] 10.222.0.23 "GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944" status: 200 len: 1725 microversion: 2.1 time: 0.220986 Jul 12 13:31:45.003829 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 219/428] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:31:44 2022] GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944 => generated 1725 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:31:45.009328 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-c6c8ae56-a7a8-47e3-90c9-c8dc1fb0cb8b tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:31:45.010171 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-c6c8ae56-a7a8-47e3-90c9-c8dc1fb0cb8b tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] [instance: c547ded0-7a14-4d94-b2e2-0434481aaa17] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:31:45.017419 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-c6c8ae56-a7a8-47e3-90c9-c8dc1fb0cb8b tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:45.017873 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-c6c8ae56-a7a8-47e3-90c9-c8dc1fb0cb8b tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:45.018649 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-c6c8ae56-a7a8-47e3-90c9-c8dc1fb0cb8b tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:45.019086 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-c6c8ae56-a7a8-47e3-90c9-c8dc1fb0cb8b tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:45.024892 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-06be5101-dcb5-41bf-a0ed-c377acf5530f tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:31:45.033545 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-06be5101-dcb5-41bf-a0ed-c377acf5530f tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:31:45.035148 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-06be5101-dcb5-41bf-a0ed-c377acf5530f tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:31:45.036426 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-06be5101-dcb5-41bf-a0ed-c377acf5530f tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f" status: 200 len: 1724 microversion: 2.20 time: 0.237475 Jul 12 13:31:45.037057 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 210/429] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:31:44 2022] GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f => generated 1724 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:31:45.179730 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-c6c8ae56-a7a8-47e3-90c9-c8dc1fb0cb8b tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd582e9b7a49c4ea6b9a1d6986d6f4163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86acb815cd62409d9856563af3037d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:31:45.188570 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-c6c8ae56-a7a8-47e3-90c9-c8dc1fb0cb8b tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] 10.222.0.23 "GET /compute/v2.1/servers/c547ded0-7a14-4d94-b2e2-0434481aaa17" status: 200 len: 1319 microversion: 2.1 time: 0.182959 Jul 12 13:31:45.189450 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 220/430] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:31:45 2022] GET /compute/v2.1/servers/c547ded0-7a14-4d94-b2e2-0434481aaa17 => generated 1319 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:31:46.024467 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-5d3b9033-42d8-42aa-8406-98d3e5621ee6 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:31:46.025074 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-5d3b9033-42d8-42aa-8406-98d3e5621ee6 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] [instance: eeb0b554-cd09-49b5-95f0-22fc7c707944] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:31:46.032604 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-5d3b9033-42d8-42aa-8406-98d3e5621ee6 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:46.033055 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-5d3b9033-42d8-42aa-8406-98d3e5621ee6 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:46.033871 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-5d3b9033-42d8-42aa-8406-98d3e5621ee6 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:46.034317 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-5d3b9033-42d8-42aa-8406-98d3e5621ee6 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:46.055921 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-82c4d69d-e318-44e5-b558-7706bbb745c2 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:31:46.056679 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-82c4d69d-e318-44e5-b558-7706bbb745c2 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 5d30ed54-909d-491f-a14c-bc4435cfdc6f] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:31:46.064771 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-82c4d69d-e318-44e5-b558-7706bbb745c2 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:46.065233 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-82c4d69d-e318-44e5-b558-7706bbb745c2 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:46.066070 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-82c4d69d-e318-44e5-b558-7706bbb745c2 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:46.066509 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-82c4d69d-e318-44e5-b558-7706bbb745c2 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:46.265074 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-5d3b9033-42d8-42aa-8406-98d3e5621ee6 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b710bbdf0c4d58b4f3ee7ef7410c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8fca4ab6ed466a864c5551fea5f7ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:31:46.272995 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-82c4d69d-e318-44e5-b558-7706bbb745c2 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:31:46.273396 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-5d3b9033-42d8-42aa-8406-98d3e5621ee6 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] 10.222.0.23 "GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944" status: 200 len: 1725 microversion: 2.1 time: 0.252884 Jul 12 13:31:46.274003 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 211/431] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:31:46 2022] GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944 => generated 1725 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:31:46.279171 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-633376eb-9af7-4cbc-8b64-2f5b218fbe9e tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:31:46.280018 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-633376eb-9af7-4cbc-8b64-2f5b218fbe9e tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] [instance: c547ded0-7a14-4d94-b2e2-0434481aaa17] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:31:46.282232 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-82c4d69d-e318-44e5-b558-7706bbb745c2 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:31:46.283847 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-82c4d69d-e318-44e5-b558-7706bbb745c2 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:31:46.285003 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-82c4d69d-e318-44e5-b558-7706bbb745c2 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f" status: 200 len: 1724 microversion: 2.20 time: 0.233139 Jul 12 13:31:46.285592 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 221/432] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:31:46 2022] GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f => generated 1724 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 13:31:46.286258 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-633376eb-9af7-4cbc-8b64-2f5b218fbe9e tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:46.286710 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-633376eb-9af7-4cbc-8b64-2f5b218fbe9e tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:46.287488 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-633376eb-9af7-4cbc-8b64-2f5b218fbe9e tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:46.287939 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-633376eb-9af7-4cbc-8b64-2f5b218fbe9e tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:46.431099 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-633376eb-9af7-4cbc-8b64-2f5b218fbe9e tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd582e9b7a49c4ea6b9a1d6986d6f4163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86acb815cd62409d9856563af3037d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:31:46.440322 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-633376eb-9af7-4cbc-8b64-2f5b218fbe9e tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] 10.222.0.23 "GET /compute/v2.1/servers/c547ded0-7a14-4d94-b2e2-0434481aaa17" status: 200 len: 1319 microversion: 2.1 time: 0.165262 Jul 12 13:31:46.440941 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 212/433] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:31:46 2022] GET /compute/v2.1/servers/c547ded0-7a14-4d94-b2e2-0434481aaa17 => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:31:47.291277 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-586aba7c-e711-4074-9800-4898b7bd265f tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:31:47.292066 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-586aba7c-e711-4074-9800-4898b7bd265f tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] [instance: eeb0b554-cd09-49b5-95f0-22fc7c707944] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:31:47.298784 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-586aba7c-e711-4074-9800-4898b7bd265f tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:47.299235 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-586aba7c-e711-4074-9800-4898b7bd265f tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:47.300005 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-586aba7c-e711-4074-9800-4898b7bd265f tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:47.300435 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-586aba7c-e711-4074-9800-4898b7bd265f tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:47.304486 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-82390c8c-6745-4489-a122-cf8bf46401b5 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:31:47.305199 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-82390c8c-6745-4489-a122-cf8bf46401b5 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 5d30ed54-909d-491f-a14c-bc4435cfdc6f] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:31:47.312640 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-82390c8c-6745-4489-a122-cf8bf46401b5 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:47.313094 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-82390c8c-6745-4489-a122-cf8bf46401b5 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:47.313920 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-82390c8c-6745-4489-a122-cf8bf46401b5 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:47.314618 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-82390c8c-6745-4489-a122-cf8bf46401b5 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:47.515384 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-586aba7c-e711-4074-9800-4898b7bd265f tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b710bbdf0c4d58b4f3ee7ef7410c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8fca4ab6ed466a864c5551fea5f7ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:31:47.523738 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-586aba7c-e711-4074-9800-4898b7bd265f tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] 10.222.0.23 "GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944" status: 200 len: 1702 microversion: 2.1 time: 0.236289 Jul 12 13:31:47.524200 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-82390c8c-6745-4489-a122-cf8bf46401b5 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:31:47.524357 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 222/434] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:31:47 2022] GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944 => generated 1702 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:31:47.530021 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-096d0314-7af3-49fa-94a6-473ccfd79ea3 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:31:47.530642 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-096d0314-7af3-49fa-94a6-473ccfd79ea3 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] [instance: c547ded0-7a14-4d94-b2e2-0434481aaa17] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:31:47.534043 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-82390c8c-6745-4489-a122-cf8bf46401b5 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:31:47.535643 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-82390c8c-6745-4489-a122-cf8bf46401b5 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:31:47.536973 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-82390c8c-6745-4489-a122-cf8bf46401b5 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f" status: 200 len: 1724 microversion: 2.20 time: 0.236552 Jul 12 13:31:47.537571 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 213/435] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:31:47 2022] GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f => generated 1724 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 13:31:47.537807 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-096d0314-7af3-49fa-94a6-473ccfd79ea3 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:47.538220 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-096d0314-7af3-49fa-94a6-473ccfd79ea3 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:47.539013 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-096d0314-7af3-49fa-94a6-473ccfd79ea3 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:47.539454 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-096d0314-7af3-49fa-94a6-473ccfd79ea3 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:47.542706 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-14ad14a5-59eb-4164-ac72-d81175fd63e2 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:31:47.549289 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-14ad14a5-59eb-4164-ac72-d81175fd63e2 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:47.549760 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-14ad14a5-59eb-4164-ac72-d81175fd63e2 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:47.614346 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-14ad14a5-59eb-4164-ac72-d81175fd63e2 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] [instance: eeb0b554-cd09-49b5-95f0-22fc7c707944] Going to try to start instance {{(pid=117987) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 12 13:31:47.663534 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-14ad14a5-59eb-4164-ac72-d81175fd63e2 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] 10.222.0.23 "POST /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944/action" status: 202 len: 0 microversion: 2.1 time: 0.124167 Jul 12 13:31:47.664526 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 214/436] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 12 13:31:47 2022] POST /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 13:31:47.678182 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-b1b37d42-0a61-4fa5-93f3-156f1d8296c9 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:31:47.679566 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-b1b37d42-0a61-4fa5-93f3-156f1d8296c9 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] [instance: eeb0b554-cd09-49b5-95f0-22fc7c707944] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:31:47.691188 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-b1b37d42-0a61-4fa5-93f3-156f1d8296c9 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:47.691968 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-b1b37d42-0a61-4fa5-93f3-156f1d8296c9 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:47.693336 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-b1b37d42-0a61-4fa5-93f3-156f1d8296c9 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:47.694137 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-b1b37d42-0a61-4fa5-93f3-156f1d8296c9 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:47.721659 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-096d0314-7af3-49fa-94a6-473ccfd79ea3 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd582e9b7a49c4ea6b9a1d6986d6f4163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86acb815cd62409d9856563af3037d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:31:47.740267 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-096d0314-7af3-49fa-94a6-473ccfd79ea3 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] 10.222.0.23 "GET /compute/v2.1/servers/c547ded0-7a14-4d94-b2e2-0434481aaa17" status: 200 len: 1507 microversion: 2.1 time: 0.214725 Jul 12 13:31:47.741941 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 223/437] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:31:47 2022] GET /compute/v2.1/servers/c547ded0-7a14-4d94-b2e2-0434481aaa17 => generated 1507 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:31:47.758837 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-05e18575-3ccf-4dd5-8225-b27878a43e34 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1fec0025-d0fa-4169-a233-07953234100e", "device": "/dev/sdb"}} {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:31:47.760678 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-05e18575-3ccf-4dd5-8225-b27878a43e34 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] [instance: c547ded0-7a14-4d94-b2e2-0434481aaa17] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:31:47.767646 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-05e18575-3ccf-4dd5-8225-b27878a43e34 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:47.768004 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-05e18575-3ccf-4dd5-8225-b27878a43e34 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:47.768785 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-05e18575-3ccf-4dd5-8225-b27878a43e34 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:47.769545 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-05e18575-3ccf-4dd5-8225-b27878a43e34 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:47.904308 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-b1b37d42-0a61-4fa5-93f3-156f1d8296c9 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b710bbdf0c4d58b4f3ee7ef7410c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8fca4ab6ed466a864c5551fea5f7ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:31:47.913174 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-b1b37d42-0a61-4fa5-93f3-156f1d8296c9 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] 10.222.0.23 "GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944" status: 200 len: 1711 microversion: 2.1 time: 0.243127 Jul 12 13:31:47.925063 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 215/438] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:31:47 2022] GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944 => generated 1711 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:31:48.085352 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG dbcounter [-] [117988] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117988) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:31:48.098095 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-05e18575-3ccf-4dd5-8225-b27878a43e34 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] 10.222.0.23 "POST /compute/v2.1/servers/c547ded0-7a14-4d94-b2e2-0434481aaa17/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.342560 Jul 12 13:31:48.098739 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 224/439] 10.222.0.23 () {60 vars in 1322 bytes} [Tue Jul 12 13:31:47 2022] POST /compute/v2.1/servers/c547ded0-7a14-4d94-b2e2-0434481aaa17/os-volume_attachments => generated 194 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 13:31:48.556278 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-53bdedc6-6e09-4201-8853-73733d40cb6d tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:31:48.557485 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-53bdedc6-6e09-4201-8853-73733d40cb6d tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 5d30ed54-909d-491f-a14c-bc4435cfdc6f] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:31:48.564630 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-53bdedc6-6e09-4201-8853-73733d40cb6d tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:48.565078 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-53bdedc6-6e09-4201-8853-73733d40cb6d tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:48.565884 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-53bdedc6-6e09-4201-8853-73733d40cb6d tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:48.566318 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-53bdedc6-6e09-4201-8853-73733d40cb6d tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:48.705827 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-53bdedc6-6e09-4201-8853-73733d40cb6d tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:31:48.713987 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-53bdedc6-6e09-4201-8853-73733d40cb6d tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:31:48.715508 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-53bdedc6-6e09-4201-8853-73733d40cb6d tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:31:48.716682 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-53bdedc6-6e09-4201-8853-73733d40cb6d tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f" status: 200 len: 1745 microversion: 2.20 time: 0.164489 Jul 12 13:31:48.717248 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 216/440] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:31:48 2022] GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f => generated 1745 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:31:48.933368 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-e5c40399-c8f2-4706-8e6b-7a1a001f22ba tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:31:48.934095 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-e5c40399-c8f2-4706-8e6b-7a1a001f22ba tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] [instance: eeb0b554-cd09-49b5-95f0-22fc7c707944] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:31:48.942452 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-e5c40399-c8f2-4706-8e6b-7a1a001f22ba tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:48.942898 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-e5c40399-c8f2-4706-8e6b-7a1a001f22ba tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:48.943668 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-e5c40399-c8f2-4706-8e6b-7a1a001f22ba tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:48.944096 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-e5c40399-c8f2-4706-8e6b-7a1a001f22ba tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:49.093581 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-e5c40399-c8f2-4706-8e6b-7a1a001f22ba tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b710bbdf0c4d58b4f3ee7ef7410c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8fca4ab6ed466a864c5551fea5f7ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:31:49.111695 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-e5c40399-c8f2-4706-8e6b-7a1a001f22ba tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] 10.222.0.23 "GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944" status: 200 len: 1711 microversion: 2.1 time: 0.183609 Jul 12 13:31:49.112290 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 225/441] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:31:48 2022] GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944 => generated 1711 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:31:49.736055 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-4d6bbd1b-d522-493a-90d7-edc628c7f9e5 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:31:49.736641 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-4d6bbd1b-d522-493a-90d7-edc628c7f9e5 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 5d30ed54-909d-491f-a14c-bc4435cfdc6f] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:31:49.743232 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-4d6bbd1b-d522-493a-90d7-edc628c7f9e5 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:49.743674 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-4d6bbd1b-d522-493a-90d7-edc628c7f9e5 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:49.745042 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-4d6bbd1b-d522-493a-90d7-edc628c7f9e5 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:49.745500 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-4d6bbd1b-d522-493a-90d7-edc628c7f9e5 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:49.876490 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-4d6bbd1b-d522-493a-90d7-edc628c7f9e5 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:31:49.884438 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-4d6bbd1b-d522-493a-90d7-edc628c7f9e5 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:31:49.887101 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-4d6bbd1b-d522-493a-90d7-edc628c7f9e5 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:31:49.888275 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-4d6bbd1b-d522-493a-90d7-edc628c7f9e5 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f" status: 200 len: 1745 microversion: 2.20 time: 0.156128 Jul 12 13:31:49.889141 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 217/442] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:31:49 2022] GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f => generated 1745 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:31:50.130264 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-e0c3229d-f8e4-4e08-b2b6-e2031e022863 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:31:50.130864 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-e0c3229d-f8e4-4e08-b2b6-e2031e022863 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] [instance: eeb0b554-cd09-49b5-95f0-22fc7c707944] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:31:50.138408 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-e0c3229d-f8e4-4e08-b2b6-e2031e022863 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:50.138893 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-e0c3229d-f8e4-4e08-b2b6-e2031e022863 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:50.139662 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-e0c3229d-f8e4-4e08-b2b6-e2031e022863 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:50.140094 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-e0c3229d-f8e4-4e08-b2b6-e2031e022863 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:50.278346 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-e0c3229d-f8e4-4e08-b2b6-e2031e022863 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b710bbdf0c4d58b4f3ee7ef7410c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8fca4ab6ed466a864c5551fea5f7ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:31:50.286409 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-e0c3229d-f8e4-4e08-b2b6-e2031e022863 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] 10.222.0.23 "GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944" status: 200 len: 1711 microversion: 2.1 time: 0.159979 Jul 12 13:31:50.287103 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 226/443] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:31:50 2022] GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944 => generated 1711 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:31:50.907047 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-6fda34e2-087c-4ec4-a333-ecfa3d82e4fb tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:31:50.907655 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-6fda34e2-087c-4ec4-a333-ecfa3d82e4fb tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 5d30ed54-909d-491f-a14c-bc4435cfdc6f] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:31:50.914080 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-6fda34e2-087c-4ec4-a333-ecfa3d82e4fb tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:50.914522 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-6fda34e2-087c-4ec4-a333-ecfa3d82e4fb tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:50.915272 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-6fda34e2-087c-4ec4-a333-ecfa3d82e4fb tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:50.915719 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-6fda34e2-087c-4ec4-a333-ecfa3d82e4fb tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:50.920615 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG dbcounter [-] [117987] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117987) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:31:51.068421 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-6fda34e2-087c-4ec4-a333-ecfa3d82e4fb tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:31:51.081564 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-6fda34e2-087c-4ec4-a333-ecfa3d82e4fb tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:31:51.083138 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-6fda34e2-087c-4ec4-a333-ecfa3d82e4fb tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:31:51.084409 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-6fda34e2-087c-4ec4-a333-ecfa3d82e4fb tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f" status: 200 len: 1745 microversion: 2.20 time: 0.181153 Jul 12 13:31:51.084976 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 218/444] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:31:50 2022] GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f => generated 1745 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:31:51.303931 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-ce9b5175-c817-4845-b110-3e1350373910 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:31:51.304654 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-ce9b5175-c817-4845-b110-3e1350373910 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] [instance: eeb0b554-cd09-49b5-95f0-22fc7c707944] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:31:51.312312 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-ce9b5175-c817-4845-b110-3e1350373910 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:51.312763 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-ce9b5175-c817-4845-b110-3e1350373910 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:51.313585 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-ce9b5175-c817-4845-b110-3e1350373910 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:51.314928 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-ce9b5175-c817-4845-b110-3e1350373910 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:51.444267 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-ce9b5175-c817-4845-b110-3e1350373910 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b710bbdf0c4d58b4f3ee7ef7410c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8fca4ab6ed466a864c5551fea5f7ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:31:51.453077 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-ce9b5175-c817-4845-b110-3e1350373910 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] 10.222.0.23 "GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944" status: 200 len: 1711 microversion: 2.1 time: 0.152911 Jul 12 13:31:51.453678 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 227/445] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:31:51 2022] GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944 => generated 1711 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:31:52.102771 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-1a842098-65b8-4f88-8e5d-86539a03d6c8 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:31:52.103360 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-1a842098-65b8-4f88-8e5d-86539a03d6c8 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 5d30ed54-909d-491f-a14c-bc4435cfdc6f] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:31:52.110331 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-1a842098-65b8-4f88-8e5d-86539a03d6c8 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:52.110772 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-1a842098-65b8-4f88-8e5d-86539a03d6c8 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:52.111520 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-1a842098-65b8-4f88-8e5d-86539a03d6c8 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:52.111946 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-1a842098-65b8-4f88-8e5d-86539a03d6c8 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:52.245834 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-1a842098-65b8-4f88-8e5d-86539a03d6c8 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:31:52.253871 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-1a842098-65b8-4f88-8e5d-86539a03d6c8 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:31:52.255365 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-1a842098-65b8-4f88-8e5d-86539a03d6c8 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:31:52.256508 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-1a842098-65b8-4f88-8e5d-86539a03d6c8 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f" status: 200 len: 1745 microversion: 2.20 time: 0.157727 Jul 12 13:31:52.257058 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 219/446] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:31:52 2022] GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f => generated 1745 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:31:52.470216 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-2901d5ac-5b7b-473a-b94c-4aaa424bbff6 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:31:52.470870 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-2901d5ac-5b7b-473a-b94c-4aaa424bbff6 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] [instance: eeb0b554-cd09-49b5-95f0-22fc7c707944] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:31:52.477817 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-2901d5ac-5b7b-473a-b94c-4aaa424bbff6 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:52.478264 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-2901d5ac-5b7b-473a-b94c-4aaa424bbff6 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:52.479197 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-2901d5ac-5b7b-473a-b94c-4aaa424bbff6 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:52.479635 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-2901d5ac-5b7b-473a-b94c-4aaa424bbff6 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:52.614930 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-2901d5ac-5b7b-473a-b94c-4aaa424bbff6 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b710bbdf0c4d58b4f3ee7ef7410c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8fca4ab6ed466a864c5551fea5f7ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:31:52.623124 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-2901d5ac-5b7b-473a-b94c-4aaa424bbff6 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] 10.222.0.23 "GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944" status: 200 len: 1711 microversion: 2.1 time: 0.156758 Jul 12 13:31:52.623641 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 228/447] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:31:52 2022] GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944 => generated 1711 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:31:53.275036 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-abc01720-d2d3-4be9-995f-d4951dbd3792 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:31:53.275689 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-abc01720-d2d3-4be9-995f-d4951dbd3792 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 5d30ed54-909d-491f-a14c-bc4435cfdc6f] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:31:53.282395 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-abc01720-d2d3-4be9-995f-d4951dbd3792 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:53.282837 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-abc01720-d2d3-4be9-995f-d4951dbd3792 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:53.283587 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-abc01720-d2d3-4be9-995f-d4951dbd3792 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:53.284013 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-abc01720-d2d3-4be9-995f-d4951dbd3792 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:53.422899 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-abc01720-d2d3-4be9-995f-d4951dbd3792 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:31:53.431006 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-abc01720-d2d3-4be9-995f-d4951dbd3792 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:31:53.433230 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-abc01720-d2d3-4be9-995f-d4951dbd3792 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:31:53.434672 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-abc01720-d2d3-4be9-995f-d4951dbd3792 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f" status: 200 len: 1745 microversion: 2.20 time: 0.163297 Jul 12 13:31:53.435051 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 220/448] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:31:53 2022] GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f => generated 1745 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:31:53.642596 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-c8f62daa-834d-4738-b3fa-78aa101e4e16 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:31:53.643350 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-c8f62daa-834d-4738-b3fa-78aa101e4e16 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] [instance: eeb0b554-cd09-49b5-95f0-22fc7c707944] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:31:53.650279 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-c8f62daa-834d-4738-b3fa-78aa101e4e16 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:53.650779 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-c8f62daa-834d-4738-b3fa-78aa101e4e16 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:53.651807 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-c8f62daa-834d-4738-b3fa-78aa101e4e16 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:53.652239 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-c8f62daa-834d-4738-b3fa-78aa101e4e16 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:53.794690 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-c8f62daa-834d-4738-b3fa-78aa101e4e16 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b710bbdf0c4d58b4f3ee7ef7410c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8fca4ab6ed466a864c5551fea5f7ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:31:53.802691 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-c8f62daa-834d-4738-b3fa-78aa101e4e16 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] 10.222.0.23 "GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944" status: 200 len: 1711 microversion: 2.1 time: 0.166417 Jul 12 13:31:53.803248 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 229/449] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:31:53 2022] GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944 => generated 1711 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:31:54.454105 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-0379cd8a-97e1-46f8-a06e-3c3476ec1389 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:31:54.454715 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-0379cd8a-97e1-46f8-a06e-3c3476ec1389 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 5d30ed54-909d-491f-a14c-bc4435cfdc6f] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:31:54.461724 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-0379cd8a-97e1-46f8-a06e-3c3476ec1389 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:54.462266 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-0379cd8a-97e1-46f8-a06e-3c3476ec1389 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:54.463555 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-0379cd8a-97e1-46f8-a06e-3c3476ec1389 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:54.463941 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-0379cd8a-97e1-46f8-a06e-3c3476ec1389 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:54.597888 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-0379cd8a-97e1-46f8-a06e-3c3476ec1389 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:31:54.606645 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-0379cd8a-97e1-46f8-a06e-3c3476ec1389 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:31:54.608144 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-0379cd8a-97e1-46f8-a06e-3c3476ec1389 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:31:54.609306 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-0379cd8a-97e1-46f8-a06e-3c3476ec1389 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f" status: 200 len: 1745 microversion: 2.20 time: 0.159238 Jul 12 13:31:54.609887 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 221/450] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:31:54 2022] GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f => generated 1745 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:31:54.820882 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-691858f2-bf8f-4958-937d-79a923bbe3a5 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:31:54.821454 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-691858f2-bf8f-4958-937d-79a923bbe3a5 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] [instance: eeb0b554-cd09-49b5-95f0-22fc7c707944] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:31:54.829627 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-691858f2-bf8f-4958-937d-79a923bbe3a5 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:54.830072 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-691858f2-bf8f-4958-937d-79a923bbe3a5 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:54.830838 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-691858f2-bf8f-4958-937d-79a923bbe3a5 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:54.831272 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-691858f2-bf8f-4958-937d-79a923bbe3a5 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:54.966030 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-691858f2-bf8f-4958-937d-79a923bbe3a5 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b710bbdf0c4d58b4f3ee7ef7410c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8fca4ab6ed466a864c5551fea5f7ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:31:54.973985 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-691858f2-bf8f-4958-937d-79a923bbe3a5 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] 10.222.0.23 "GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944" status: 200 len: 1715 microversion: 2.1 time: 0.157568 Jul 12 13:31:54.974553 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 230/451] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:31:54 2022] GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944 => generated 1715 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:31:55.627978 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-f516f484-b717-4cc2-a2a1-759cdcef1329 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:31:55.628616 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-f516f484-b717-4cc2-a2a1-759cdcef1329 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 5d30ed54-909d-491f-a14c-bc4435cfdc6f] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:31:55.635725 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-f516f484-b717-4cc2-a2a1-759cdcef1329 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:55.636388 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-f516f484-b717-4cc2-a2a1-759cdcef1329 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:55.637218 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-f516f484-b717-4cc2-a2a1-759cdcef1329 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:55.637673 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-f516f484-b717-4cc2-a2a1-759cdcef1329 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:55.771435 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-f516f484-b717-4cc2-a2a1-759cdcef1329 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:31:55.779647 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-f516f484-b717-4cc2-a2a1-759cdcef1329 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:31:55.781137 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-f516f484-b717-4cc2-a2a1-759cdcef1329 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:31:55.782308 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-f516f484-b717-4cc2-a2a1-759cdcef1329 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f" status: 200 len: 1745 microversion: 2.20 time: 0.158226 Jul 12 13:31:55.782870 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 222/452] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:31:55 2022] GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f => generated 1745 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:31:56.801817 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-eabeee3e-e4e6-494a-81ba-9931297f7344 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:31:56.802417 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-eabeee3e-e4e6-494a-81ba-9931297f7344 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 5d30ed54-909d-491f-a14c-bc4435cfdc6f] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:31:56.809733 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-eabeee3e-e4e6-494a-81ba-9931297f7344 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:56.810184 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-eabeee3e-e4e6-494a-81ba-9931297f7344 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:56.810954 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-eabeee3e-e4e6-494a-81ba-9931297f7344 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:56.811391 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-eabeee3e-e4e6-494a-81ba-9931297f7344 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:56.945976 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-eabeee3e-e4e6-494a-81ba-9931297f7344 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:31:56.954589 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-eabeee3e-e4e6-494a-81ba-9931297f7344 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:31:56.956098 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-eabeee3e-e4e6-494a-81ba-9931297f7344 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:31:56.957254 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-eabeee3e-e4e6-494a-81ba-9931297f7344 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f" status: 200 len: 1745 microversion: 2.20 time: 0.159379 Jul 12 13:31:56.957840 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 231/453] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:31:56 2022] GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f => generated 1745 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:31:57.730826 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [req-de871374-0374-4bdb-a0a5-e2bd3dfc8b51 req-133ff131-1f47-416d-a1b1-48c750ccd8aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d30ed54-909d-491f-a14c-bc4435cfdc6f", "name": "network-vif-plugged", "status": "completed", "tag": "f13aa237-fefb-4e93-8923-7007031116c1"}]} {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:31:57.739903 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [req-de871374-0374-4bdb-a0a5-e2bd3dfc8b51 req-133ff131-1f47-416d-a1b1-48c750ccd8aa service nova] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:57.740369 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [req-de871374-0374-4bdb-a0a5-e2bd3dfc8b51 req-133ff131-1f47-416d-a1b1-48c750ccd8aa service nova] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:57.752958 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.compute.server_external_events [req-de871374-0374-4bdb-a0a5-e2bd3dfc8b51 req-133ff131-1f47-416d-a1b1-48c750ccd8aa service nova] Creating event network-vif-plugged:f13aa237-fefb-4e93-8923-7007031116c1 for instance 5d30ed54-909d-491f-a14c-bc4435cfdc6f on hv-cinder-82002 Jul 12 13:31:57.758288 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [req-de871374-0374-4bdb-a0a5-e2bd3dfc8b51 req-133ff131-1f47-416d-a1b1-48c750ccd8aa service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031823 Jul 12 13:31:57.758883 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 223/454] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 12 13:31:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:31:57.976028 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-396ff19d-67c6-4545-ab44-287d5a3d5815 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:31:57.976698 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-396ff19d-67c6-4545-ab44-287d5a3d5815 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 5d30ed54-909d-491f-a14c-bc4435cfdc6f] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:31:57.983338 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-396ff19d-67c6-4545-ab44-287d5a3d5815 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:57.983782 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-396ff19d-67c6-4545-ab44-287d5a3d5815 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:57.984538 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-396ff19d-67c6-4545-ab44-287d5a3d5815 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:57.984969 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-396ff19d-67c6-4545-ab44-287d5a3d5815 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:58.113739 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-396ff19d-67c6-4545-ab44-287d5a3d5815 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:31:58.122084 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-396ff19d-67c6-4545-ab44-287d5a3d5815 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:31:58.124094 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-396ff19d-67c6-4545-ab44-287d5a3d5815 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:31:58.125588 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-396ff19d-67c6-4545-ab44-287d5a3d5815 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f" status: 200 len: 1745 microversion: 2.20 time: 0.153466 Jul 12 13:31:58.126141 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 232/455] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:31:57 2022] GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f => generated 1745 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:31:59.154951 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-8cb5d770-e022-43c8-85d4-bb6bcce0b8b6 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:31:59.155641 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-8cb5d770-e022-43c8-85d4-bb6bcce0b8b6 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 5d30ed54-909d-491f-a14c-bc4435cfdc6f] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:31:59.161972 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-8cb5d770-e022-43c8-85d4-bb6bcce0b8b6 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:59.162422 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-8cb5d770-e022-43c8-85d4-bb6bcce0b8b6 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:59.163227 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-8cb5d770-e022-43c8-85d4-bb6bcce0b8b6 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:31:59.163667 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-8cb5d770-e022-43c8-85d4-bb6bcce0b8b6 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:31:59.301300 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-8cb5d770-e022-43c8-85d4-bb6bcce0b8b6 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:31:59.310218 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-8cb5d770-e022-43c8-85d4-bb6bcce0b8b6 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:31:59.311724 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-8cb5d770-e022-43c8-85d4-bb6bcce0b8b6 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:31:59.312876 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-8cb5d770-e022-43c8-85d4-bb6bcce0b8b6 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f" status: 200 len: 1745 microversion: 2.20 time: 0.163026 Jul 12 13:31:59.313449 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 224/456] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:31:59 2022] GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f => generated 1745 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:32:00.332147 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-19b330c4-d144-4fbf-9b3d-8b167a70c4e0 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:32:00.332668 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-19b330c4-d144-4fbf-9b3d-8b167a70c4e0 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 5d30ed54-909d-491f-a14c-bc4435cfdc6f] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:32:00.340006 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-19b330c4-d144-4fbf-9b3d-8b167a70c4e0 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:32:00.340532 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-19b330c4-d144-4fbf-9b3d-8b167a70c4e0 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:32:00.341598 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-19b330c4-d144-4fbf-9b3d-8b167a70c4e0 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:32:00.342044 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-19b330c4-d144-4fbf-9b3d-8b167a70c4e0 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:32:00.478812 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-19b330c4-d144-4fbf-9b3d-8b167a70c4e0 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:32:00.486786 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-19b330c4-d144-4fbf-9b3d-8b167a70c4e0 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:32:00.488295 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-19b330c4-d144-4fbf-9b3d-8b167a70c4e0 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:32:00.489481 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-19b330c4-d144-4fbf-9b3d-8b167a70c4e0 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f" status: 200 len: 1745 microversion: 2.20 time: 0.161301 Jul 12 13:32:00.490037 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 233/457] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:32:00 2022] GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f => generated 1745 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:32:01.507431 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-fcf4562d-e847-4983-a412-71e3141b875a tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:32:01.508031 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-fcf4562d-e847-4983-a412-71e3141b875a tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 5d30ed54-909d-491f-a14c-bc4435cfdc6f] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:32:01.515156 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-fcf4562d-e847-4983-a412-71e3141b875a tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:32:01.515604 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-fcf4562d-e847-4983-a412-71e3141b875a tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:32:01.516367 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-fcf4562d-e847-4983-a412-71e3141b875a tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:32:01.516799 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-fcf4562d-e847-4983-a412-71e3141b875a tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:32:01.651120 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-fcf4562d-e847-4983-a412-71e3141b875a tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:32:01.660582 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-fcf4562d-e847-4983-a412-71e3141b875a tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:32:01.662188 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-fcf4562d-e847-4983-a412-71e3141b875a tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:32:01.663369 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-fcf4562d-e847-4983-a412-71e3141b875a tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f" status: 200 len: 1745 microversion: 2.20 time: 0.159844 Jul 12 13:32:01.663935 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 225/458] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:32:01 2022] GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f => generated 1745 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:32:02.682458 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-27bf669a-eec1-4be7-8675-b44493b60e7f tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:32:02.683122 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-27bf669a-eec1-4be7-8675-b44493b60e7f tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 5d30ed54-909d-491f-a14c-bc4435cfdc6f] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:32:02.686617 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG dbcounter [-] [117988] Writing DB stats nova_api:SELECT=70 {{(pid=117988) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:32:02.692515 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-27bf669a-eec1-4be7-8675-b44493b60e7f tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:32:02.692964 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-27bf669a-eec1-4be7-8675-b44493b60e7f tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:32:02.693761 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-27bf669a-eec1-4be7-8675-b44493b60e7f tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:32:02.694199 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-27bf669a-eec1-4be7-8675-b44493b60e7f tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:32:02.836898 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-27bf669a-eec1-4be7-8675-b44493b60e7f tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:32:02.847354 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-27bf669a-eec1-4be7-8675-b44493b60e7f tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:32:02.849075 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-27bf669a-eec1-4be7-8675-b44493b60e7f tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:32:02.850441 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-27bf669a-eec1-4be7-8675-b44493b60e7f tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f" status: 200 len: 1745 microversion: 2.20 time: 0.171931 Jul 12 13:32:02.851069 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 234/459] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:32:02 2022] GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f => generated 1745 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:32:03.874276 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-6e882970-2bee-4420-84b4-abcaffdc3a7e tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:32:03.874939 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-6e882970-2bee-4420-84b4-abcaffdc3a7e tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 5d30ed54-909d-491f-a14c-bc4435cfdc6f] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:32:03.882359 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-6e882970-2bee-4420-84b4-abcaffdc3a7e tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:32:03.883177 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-6e882970-2bee-4420-84b4-abcaffdc3a7e tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:32:03.884389 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-6e882970-2bee-4420-84b4-abcaffdc3a7e tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:32:03.885135 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-6e882970-2bee-4420-84b4-abcaffdc3a7e tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:32:04.056730 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-6e882970-2bee-4420-84b4-abcaffdc3a7e tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:32:04.075517 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-6e882970-2bee-4420-84b4-abcaffdc3a7e tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:32:04.079721 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-6e882970-2bee-4420-84b4-abcaffdc3a7e tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:32:04.082042 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-6e882970-2bee-4420-84b4-abcaffdc3a7e tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f" status: 200 len: 1740 microversion: 2.20 time: 0.213160 Jul 12 13:32:04.097403 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 226/460] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:32:03 2022] GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f => generated 1740 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:32:05.112962 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-6000c69a-afd4-4ec0-b0f2-a131b2e50c30 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:32:05.113747 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-6000c69a-afd4-4ec0-b0f2-a131b2e50c30 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 5d30ed54-909d-491f-a14c-bc4435cfdc6f] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:32:05.121147 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-6000c69a-afd4-4ec0-b0f2-a131b2e50c30 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:32:05.121915 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-6000c69a-afd4-4ec0-b0f2-a131b2e50c30 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:32:05.122990 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-6000c69a-afd4-4ec0-b0f2-a131b2e50c30 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:32:05.123614 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-6000c69a-afd4-4ec0-b0f2-a131b2e50c30 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:32:05.312245 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-6000c69a-afd4-4ec0-b0f2-a131b2e50c30 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:32:05.323106 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-6000c69a-afd4-4ec0-b0f2-a131b2e50c30 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:32:05.325562 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-6000c69a-afd4-4ec0-b0f2-a131b2e50c30 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:32:05.326793 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-6000c69a-afd4-4ec0-b0f2-a131b2e50c30 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f" status: 200 len: 1740 microversion: 2.20 time: 0.217804 Jul 12 13:32:05.327374 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 235/461] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:32:05 2022] GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f => generated 1740 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 13:32:06.346341 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-a13271e5-9ce0-4edf-9ba4-4a86c55ef1ec tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:32:06.348018 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-a13271e5-9ce0-4edf-9ba4-4a86c55ef1ec tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 5d30ed54-909d-491f-a14c-bc4435cfdc6f] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:32:06.357637 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-a13271e5-9ce0-4edf-9ba4-4a86c55ef1ec tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:32:06.358223 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-a13271e5-9ce0-4edf-9ba4-4a86c55ef1ec tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:32:06.359124 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-a13271e5-9ce0-4edf-9ba4-4a86c55ef1ec tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:32:06.359651 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-a13271e5-9ce0-4edf-9ba4-4a86c55ef1ec tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:32:06.537765 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-a13271e5-9ce0-4edf-9ba4-4a86c55ef1ec tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:32:06.547721 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-a13271e5-9ce0-4edf-9ba4-4a86c55ef1ec tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:32:06.550117 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-a13271e5-9ce0-4edf-9ba4-4a86c55ef1ec tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:32:06.551870 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-a13271e5-9ce0-4edf-9ba4-4a86c55ef1ec tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f" status: 200 len: 1740 microversion: 2.20 time: 0.210694 Jul 12 13:32:06.552615 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 227/462] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:32:06 2022] GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f => generated 1740 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:32:07.572960 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-d579f26c-7fc5-405a-821a-4a807c436b51 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:32:07.574302 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-d579f26c-7fc5-405a-821a-4a807c436b51 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 5d30ed54-909d-491f-a14c-bc4435cfdc6f] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:32:07.583160 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-d579f26c-7fc5-405a-821a-4a807c436b51 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:32:07.583506 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-d579f26c-7fc5-405a-821a-4a807c436b51 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:32:07.584453 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-d579f26c-7fc5-405a-821a-4a807c436b51 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:32:07.584893 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-d579f26c-7fc5-405a-821a-4a807c436b51 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:32:07.889209 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-d579f26c-7fc5-405a-821a-4a807c436b51 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:32:07.903115 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-d579f26c-7fc5-405a-821a-4a807c436b51 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:32:07.904859 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-d579f26c-7fc5-405a-821a-4a807c436b51 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:32:07.906792 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-d579f26c-7fc5-405a-821a-4a807c436b51 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f" status: 200 len: 1740 microversion: 2.20 time: 0.337634 Jul 12 13:32:07.907830 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 236/463] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:32:07 2022] GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f => generated 1740 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:32:08.927542 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-ed19c004-d1a1-450c-84fd-d7cb9de02a3d tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:32:08.929532 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-ed19c004-d1a1-450c-84fd-d7cb9de02a3d tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 5d30ed54-909d-491f-a14c-bc4435cfdc6f] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:32:08.932421 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG dbcounter [-] [117987] Writing DB stats nova_api:SELECT=58 {{(pid=117987) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:32:08.938930 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-ed19c004-d1a1-450c-84fd-d7cb9de02a3d tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:32:08.939883 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-ed19c004-d1a1-450c-84fd-d7cb9de02a3d tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:32:08.940825 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-ed19c004-d1a1-450c-84fd-d7cb9de02a3d tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:32:08.941456 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-ed19c004-d1a1-450c-84fd-d7cb9de02a3d tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:32:09.113638 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-ed19c004-d1a1-450c-84fd-d7cb9de02a3d tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:32:09.124570 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-ed19c004-d1a1-450c-84fd-d7cb9de02a3d tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:32:09.126901 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-ed19c004-d1a1-450c-84fd-d7cb9de02a3d tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:32:09.128713 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-ed19c004-d1a1-450c-84fd-d7cb9de02a3d tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f" status: 200 len: 1740 microversion: 2.20 time: 0.205664 Jul 12 13:32:09.129304 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 228/464] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:32:08 2022] GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f => generated 1740 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:32:10.156591 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-28349065-6490-4af8-b0b6-7381f669f597 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:32:10.157284 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-28349065-6490-4af8-b0b6-7381f669f597 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 5d30ed54-909d-491f-a14c-bc4435cfdc6f] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:32:10.165920 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-28349065-6490-4af8-b0b6-7381f669f597 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:32:10.166996 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-28349065-6490-4af8-b0b6-7381f669f597 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:32:10.168950 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-28349065-6490-4af8-b0b6-7381f669f597 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:32:10.169685 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-28349065-6490-4af8-b0b6-7381f669f597 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:32:10.342829 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-28349065-6490-4af8-b0b6-7381f669f597 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:32:10.367366 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-28349065-6490-4af8-b0b6-7381f669f597 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:32:10.371433 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-28349065-6490-4af8-b0b6-7381f669f597 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:32:10.374231 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-28349065-6490-4af8-b0b6-7381f669f597 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f" status: 200 len: 1740 microversion: 2.20 time: 0.223235 Jul 12 13:32:10.389418 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 237/465] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:32:10 2022] GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f => generated 1740 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:32:11.409653 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-10dd5469-7bf9-493d-a869-ae9b48189670 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:32:11.410702 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-10dd5469-7bf9-493d-a869-ae9b48189670 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 5d30ed54-909d-491f-a14c-bc4435cfdc6f] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:32:11.419922 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-10dd5469-7bf9-493d-a869-ae9b48189670 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:32:11.420365 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-10dd5469-7bf9-493d-a869-ae9b48189670 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:32:11.421252 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-10dd5469-7bf9-493d-a869-ae9b48189670 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:32:11.421896 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-10dd5469-7bf9-493d-a869-ae9b48189670 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:32:11.643835 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-10dd5469-7bf9-493d-a869-ae9b48189670 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:32:11.660263 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-10dd5469-7bf9-493d-a869-ae9b48189670 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:32:11.661823 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-10dd5469-7bf9-493d-a869-ae9b48189670 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:32:11.663253 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-10dd5469-7bf9-493d-a869-ae9b48189670 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f" status: 200 len: 1740 microversion: 2.20 time: 0.259886 Jul 12 13:32:11.664007 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 229/466] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:32:11 2022] GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f => generated 1740 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:32:12.686811 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-cc5dfda7-49f7-48ad-95c7-50a14d3a72e4 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:32:12.687442 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-cc5dfda7-49f7-48ad-95c7-50a14d3a72e4 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 5d30ed54-909d-491f-a14c-bc4435cfdc6f] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:32:12.702821 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-cc5dfda7-49f7-48ad-95c7-50a14d3a72e4 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:32:12.703582 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-cc5dfda7-49f7-48ad-95c7-50a14d3a72e4 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:32:12.704583 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-cc5dfda7-49f7-48ad-95c7-50a14d3a72e4 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:32:12.705014 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-cc5dfda7-49f7-48ad-95c7-50a14d3a72e4 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:32:12.896735 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-cc5dfda7-49f7-48ad-95c7-50a14d3a72e4 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:32:12.909589 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-cc5dfda7-49f7-48ad-95c7-50a14d3a72e4 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:32:12.911242 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-cc5dfda7-49f7-48ad-95c7-50a14d3a72e4 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:32:12.912573 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-cc5dfda7-49f7-48ad-95c7-50a14d3a72e4 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f" status: 200 len: 1740 microversion: 2.20 time: 0.232079 Jul 12 13:32:12.913429 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 238/467] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:32:12 2022] GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f => generated 1740 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:32:13.931266 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-8461f196-543f-4b70-9e7c-87d9028b720e tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:32:13.931838 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-8461f196-543f-4b70-9e7c-87d9028b720e tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 5d30ed54-909d-491f-a14c-bc4435cfdc6f] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:32:13.939073 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-8461f196-543f-4b70-9e7c-87d9028b720e tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:32:13.939777 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-8461f196-543f-4b70-9e7c-87d9028b720e tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:32:13.940526 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-8461f196-543f-4b70-9e7c-87d9028b720e tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:32:13.940952 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-8461f196-543f-4b70-9e7c-87d9028b720e tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:32:14.079933 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-8461f196-543f-4b70-9e7c-87d9028b720e tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:32:14.088110 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-8461f196-543f-4b70-9e7c-87d9028b720e tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:32:14.090160 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-8461f196-543f-4b70-9e7c-87d9028b720e tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:32:14.091344 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-8461f196-543f-4b70-9e7c-87d9028b720e tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f" status: 200 len: 1740 microversion: 2.20 time: 0.164063 Jul 12 13:32:14.091994 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 230/468] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:32:13 2022] GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f => generated 1740 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:32:15.111556 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-373588c0-3a13-4fe7-b100-6efd93adfdec tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:32:15.112146 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-373588c0-3a13-4fe7-b100-6efd93adfdec tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 5d30ed54-909d-491f-a14c-bc4435cfdc6f] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:32:15.118270 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-373588c0-3a13-4fe7-b100-6efd93adfdec tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:32:15.118881 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-373588c0-3a13-4fe7-b100-6efd93adfdec tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:32:15.119746 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-373588c0-3a13-4fe7-b100-6efd93adfdec tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:32:15.120261 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-373588c0-3a13-4fe7-b100-6efd93adfdec tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:32:15.442136 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-373588c0-3a13-4fe7-b100-6efd93adfdec tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:32:15.450721 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-373588c0-3a13-4fe7-b100-6efd93adfdec tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:32:15.452279 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-373588c0-3a13-4fe7-b100-6efd93adfdec tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:32:15.453512 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-373588c0-3a13-4fe7-b100-6efd93adfdec tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f" status: 200 len: 1740 microversion: 2.20 time: 0.346375 Jul 12 13:32:15.454080 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 239/469] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:32:15 2022] GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f => generated 1740 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:32:16.472210 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-89f337c1-38b0-450f-843a-892012e004f7 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:32:16.472828 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-89f337c1-38b0-450f-843a-892012e004f7 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 5d30ed54-909d-491f-a14c-bc4435cfdc6f] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:32:16.479885 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-89f337c1-38b0-450f-843a-892012e004f7 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:32:16.480377 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-89f337c1-38b0-450f-843a-892012e004f7 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:32:16.481479 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-89f337c1-38b0-450f-843a-892012e004f7 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:32:16.481917 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-89f337c1-38b0-450f-843a-892012e004f7 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:32:16.716133 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-89f337c1-38b0-450f-843a-892012e004f7 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:32:16.724534 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-89f337c1-38b0-450f-843a-892012e004f7 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:32:16.726078 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-89f337c1-38b0-450f-843a-892012e004f7 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:32:16.727256 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-89f337c1-38b0-450f-843a-892012e004f7 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f" status: 200 len: 1722 microversion: 2.20 time: 0.259095 Jul 12 13:32:16.727825 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 231/470] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:32:16 2022] GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f => generated 1722 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:32:17.747002 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-13ae440b-4c95-4164-a617-046342c46f9e tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:32:17.747621 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-13ae440b-4c95-4164-a617-046342c46f9e tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 5d30ed54-909d-491f-a14c-bc4435cfdc6f] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:32:17.754656 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-13ae440b-4c95-4164-a617-046342c46f9e tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:32:17.755108 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-13ae440b-4c95-4164-a617-046342c46f9e tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:32:17.755894 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-13ae440b-4c95-4164-a617-046342c46f9e tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:32:17.756328 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-13ae440b-4c95-4164-a617-046342c46f9e tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:32:17.902210 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-13ae440b-4c95-4164-a617-046342c46f9e tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:32:17.911330 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-13ae440b-4c95-4164-a617-046342c46f9e tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:32:17.912830 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-13ae440b-4c95-4164-a617-046342c46f9e tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:32:17.914035 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-13ae440b-4c95-4164-a617-046342c46f9e tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f" status: 200 len: 1722 microversion: 2.20 time: 0.171419 Jul 12 13:32:17.914605 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 240/471] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:32:17 2022] GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 13:32:18.935705 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-1bcc671a-3de1-4afe-8ab0-212f3dfeeef0 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:32:18.936398 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-1bcc671a-3de1-4afe-8ab0-212f3dfeeef0 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 5d30ed54-909d-491f-a14c-bc4435cfdc6f] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:32:18.943498 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-1bcc671a-3de1-4afe-8ab0-212f3dfeeef0 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:32:18.943945 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-1bcc671a-3de1-4afe-8ab0-212f3dfeeef0 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:32:18.944729 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-1bcc671a-3de1-4afe-8ab0-212f3dfeeef0 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:32:18.945168 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-1bcc671a-3de1-4afe-8ab0-212f3dfeeef0 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:32:19.101776 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-1bcc671a-3de1-4afe-8ab0-212f3dfeeef0 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:32:19.110821 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-1bcc671a-3de1-4afe-8ab0-212f3dfeeef0 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:32:19.112331 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-1bcc671a-3de1-4afe-8ab0-212f3dfeeef0 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:32:19.113537 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-1bcc671a-3de1-4afe-8ab0-212f3dfeeef0 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f" status: 200 len: 1722 microversion: 2.20 time: 0.182049 Jul 12 13:32:19.114100 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 232/472] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:32:18 2022] GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f => generated 1722 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:32:20.133708 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-9a7beff7-1a94-4639-818e-82d5b706f52e tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:32:20.134351 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-9a7beff7-1a94-4639-818e-82d5b706f52e tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 5d30ed54-909d-491f-a14c-bc4435cfdc6f] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:32:20.142005 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-9a7beff7-1a94-4639-818e-82d5b706f52e tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:32:20.142456 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-9a7beff7-1a94-4639-818e-82d5b706f52e tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:32:20.143304 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-9a7beff7-1a94-4639-818e-82d5b706f52e tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:32:20.143743 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-9a7beff7-1a94-4639-818e-82d5b706f52e tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:32:20.146631 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG dbcounter [-] [117988] Writing DB stats nova_cell1:SELECT=97 {{(pid=117988) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:32:20.309645 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-9a7beff7-1a94-4639-818e-82d5b706f52e tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:32:20.318580 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-9a7beff7-1a94-4639-818e-82d5b706f52e tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:32:20.320110 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-9a7beff7-1a94-4639-818e-82d5b706f52e tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:32:20.321303 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-9a7beff7-1a94-4639-818e-82d5b706f52e tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f" status: 200 len: 1722 microversion: 2.20 time: 0.191782 Jul 12 13:32:20.321906 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 241/473] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:32:20 2022] GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f => generated 1722 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:32:21.343064 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-c5844953-0598-4037-973f-39c160e9770d tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:32:21.343840 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-c5844953-0598-4037-973f-39c160e9770d tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 5d30ed54-909d-491f-a14c-bc4435cfdc6f] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:32:21.351138 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-c5844953-0598-4037-973f-39c160e9770d tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:32:21.351710 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-c5844953-0598-4037-973f-39c160e9770d tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:32:21.352766 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-c5844953-0598-4037-973f-39c160e9770d tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:32:21.353365 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-c5844953-0598-4037-973f-39c160e9770d tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:32:21.357213 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG dbcounter [-] [117987] Writing DB stats nova_cell1:SELECT=85 {{(pid=117987) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:32:21.498220 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-c5844953-0598-4037-973f-39c160e9770d tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:32:21.507604 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-c5844953-0598-4037-973f-39c160e9770d tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:32:21.509349 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-c5844953-0598-4037-973f-39c160e9770d tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:32:21.510641 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-c5844953-0598-4037-973f-39c160e9770d tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f" status: 200 len: 1722 microversion: 2.20 time: 0.172749 Jul 12 13:32:21.513154 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 233/474] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:32:21 2022] GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:32:22.532157 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-0e2381e0-ffd7-448b-9041-63bf41df4510 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:32:22.533775 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-0e2381e0-ffd7-448b-9041-63bf41df4510 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 5d30ed54-909d-491f-a14c-bc4435cfdc6f] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:32:22.540568 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-0e2381e0-ffd7-448b-9041-63bf41df4510 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:32:22.541197 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-0e2381e0-ffd7-448b-9041-63bf41df4510 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:32:22.543061 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-0e2381e0-ffd7-448b-9041-63bf41df4510 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:32:22.543739 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-0e2381e0-ffd7-448b-9041-63bf41df4510 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:32:22.656727 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [req-08cdaa40-e2f9-492b-97f5-abc577ad8abd req-ec712e32-3c43-45e0-b412-c5cc49bdcac9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d30ed54-909d-491f-a14c-bc4435cfdc6f", "name": "network-vif-unplugged", "status": "completed", "tag": "f13aa237-fefb-4e93-8923-7007031116c1"}]} {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:32:22.666958 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [req-08cdaa40-e2f9-492b-97f5-abc577ad8abd req-ec712e32-3c43-45e0-b412-c5cc49bdcac9 service nova] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:32:22.667397 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [req-08cdaa40-e2f9-492b-97f5-abc577ad8abd req-ec712e32-3c43-45e0-b412-c5cc49bdcac9 service nova] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:32:22.681481 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.compute.server_external_events [req-08cdaa40-e2f9-492b-97f5-abc577ad8abd req-ec712e32-3c43-45e0-b412-c5cc49bdcac9 service nova] Creating event network-vif-unplugged:f13aa237-fefb-4e93-8923-7007031116c1 for instance 5d30ed54-909d-491f-a14c-bc4435cfdc6f on hv-cinder-82002 Jul 12 13:32:22.687880 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [req-08cdaa40-e2f9-492b-97f5-abc577ad8abd req-ec712e32-3c43-45e0-b412-c5cc49bdcac9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035655 Jul 12 13:32:22.689217 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 234/475] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 12 13:32:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 13:32:22.773530 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-0e2381e0-ffd7-448b-9041-63bf41df4510 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:32:22.782277 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-0e2381e0-ffd7-448b-9041-63bf41df4510 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:32:22.783838 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-0e2381e0-ffd7-448b-9041-63bf41df4510 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:32:22.784966 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-0e2381e0-ffd7-448b-9041-63bf41df4510 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f" status: 200 len: 1722 microversion: 2.20 time: 0.256878 Jul 12 13:32:22.788708 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 242/476] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:32:22 2022] GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f => generated 1722 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:32:23.298891 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 12 13:32:23.299145 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: Tue Jul 12 13:32:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 12 13:32:23.914132 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-ed68706b-b6ea-483b-b51c-447ec81042b2 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:32:23.914838 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-ed68706b-b6ea-483b-b51c-447ec81042b2 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 5d30ed54-909d-491f-a14c-bc4435cfdc6f] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:32:23.922180 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-ed68706b-b6ea-483b-b51c-447ec81042b2 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:32:23.922635 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-ed68706b-b6ea-483b-b51c-447ec81042b2 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:32:23.923397 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-ed68706b-b6ea-483b-b51c-447ec81042b2 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:32:23.923826 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-ed68706b-b6ea-483b-b51c-447ec81042b2 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:32:24.061489 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-ed68706b-b6ea-483b-b51c-447ec81042b2 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:32:24.070575 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-ed68706b-b6ea-483b-b51c-447ec81042b2 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:32:24.072076 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-ed68706b-b6ea-483b-b51c-447ec81042b2 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:32:24.073762 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-ed68706b-b6ea-483b-b51c-447ec81042b2 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f" status: 200 len: 1665 microversion: 2.20 time: 0.269775 Jul 12 13:32:24.074475 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 235/477] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:32:23 2022] GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f => generated 1665 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:32:24.092172 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-1d47c29d-7f14-4440-8951-459c4597d1ed tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9debd6f8-718d-4d7d-b6d9-c964d4a1c7cb"}} {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:32:24.093640 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-1d47c29d-7f14-4440-8951-459c4597d1ed tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 5d30ed54-909d-491f-a14c-bc4435cfdc6f] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:32:24.100099 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-1d47c29d-7f14-4440-8951-459c4597d1ed tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:32:24.100541 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-1d47c29d-7f14-4440-8951-459c4597d1ed tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:32:24.101303 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-1d47c29d-7f14-4440-8951-459c4597d1ed tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:32:24.101754 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-1d47c29d-7f14-4440-8951-459c4597d1ed tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:32:24.398880 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-1d47c29d-7f14-4440-8951-459c4597d1ed tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "POST /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.311599 Jul 12 13:32:24.399489 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 243/478] 10.222.0.23 () {62 vars in 1363 bytes} [Tue Jul 12 13:32:24 2022] POST /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f/os-volume_attachments => generated 188 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 13:32:24.517601 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-13469d0b-6e1f-47b3-86ee-c4c24df1dca3 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:32:24.518168 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-13469d0b-6e1f-47b3-86ee-c4c24df1dca3 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 5d30ed54-909d-491f-a14c-bc4435cfdc6f] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:32:24.524164 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-13469d0b-6e1f-47b3-86ee-c4c24df1dca3 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:32:24.524606 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-13469d0b-6e1f-47b3-86ee-c4c24df1dca3 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:32:24.525360 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-13469d0b-6e1f-47b3-86ee-c4c24df1dca3 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:32:24.525819 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-13469d0b-6e1f-47b3-86ee-c4c24df1dca3 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:32:24.616413 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-13469d0b-6e1f-47b3-86ee-c4c24df1dca3 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "POST /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f/action" status: 202 len: 0 microversion: 2.20 time: 0.102755 Jul 12 13:32:24.617024 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 236/479] 10.222.0.23 () {62 vars in 1318 bytes} [Tue Jul 12 13:32:24 2022] POST /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f/action => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 12 13:32:24.626698 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-e2e775aa-cc63-48a7-925b-4303632857a1 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:32:24.627306 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-e2e775aa-cc63-48a7-925b-4303632857a1 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 5d30ed54-909d-491f-a14c-bc4435cfdc6f] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:32:24.633930 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-e2e775aa-cc63-48a7-925b-4303632857a1 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:32:24.634528 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-e2e775aa-cc63-48a7-925b-4303632857a1 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:32:24.635232 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-e2e775aa-cc63-48a7-925b-4303632857a1 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:32:24.635661 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-e2e775aa-cc63-48a7-925b-4303632857a1 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:32:24.778856 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-4a78a7ae-97c6-4280-8339-7e8824aa6e17 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:32:24.779008 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-e2e775aa-cc63-48a7-925b-4303632857a1 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:32:24.779663 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-4a78a7ae-97c6-4280-8339-7e8824aa6e17 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] [instance: c547ded0-7a14-4d94-b2e2-0434481aaa17] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:32:24.788390 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-e2e775aa-cc63-48a7-925b-4303632857a1 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:32:24.790035 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-4a78a7ae-97c6-4280-8339-7e8824aa6e17 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:32:24.790168 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-e2e775aa-cc63-48a7-925b-4303632857a1 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:32:24.790746 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-4a78a7ae-97c6-4280-8339-7e8824aa6e17 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:32:24.791535 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-4a78a7ae-97c6-4280-8339-7e8824aa6e17 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:32:24.791688 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-e2e775aa-cc63-48a7-925b-4303632857a1 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f" status: 200 len: 1751 microversion: 2.20 time: 0.169013 Jul 12 13:32:24.792616 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-4a78a7ae-97c6-4280-8339-7e8824aa6e17 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:32:24.793456 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 244/480] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:32:24 2022] GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f => generated 1751 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:32:24.921476 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.objects.instance [None req-4a78a7ae-97c6-4280-8339-7e8824aa6e17 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lazy-loading 'services' on Instance uuid c547ded0-7a14-4d94-b2e2-0434481aaa17 {{(pid=117987) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 13:32:25.043788 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-4a78a7ae-97c6-4280-8339-7e8824aa6e17 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c547ded0-7a14-4d94-b2e2-0434481aaa17/os-volume_attachments/1fec0025-d0fa-4169-a233-07953234100e" status: 202 len: 0 microversion: 2.1 time: 0.273824 Jul 12 13:32:25.044402 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 237/481] 10.222.0.23 () {58 vars in 1415 bytes} [Tue Jul 12 13:32:24 2022] DELETE /compute/v2.1/servers/c547ded0-7a14-4d94-b2e2-0434481aaa17/os-volume_attachments/1fec0025-d0fa-4169-a233-07953234100e => generated 0 bytes in 276 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 13:32:25.811023 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-bfed8302-cc5e-46e1-a676-dc2deb704d83 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:32:25.811639 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-bfed8302-cc5e-46e1-a676-dc2deb704d83 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 5d30ed54-909d-491f-a14c-bc4435cfdc6f] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:32:25.819881 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-bfed8302-cc5e-46e1-a676-dc2deb704d83 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:32:25.820267 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-bfed8302-cc5e-46e1-a676-dc2deb704d83 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:32:25.821205 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-bfed8302-cc5e-46e1-a676-dc2deb704d83 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:32:25.821680 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-bfed8302-cc5e-46e1-a676-dc2deb704d83 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:32:26.181470 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-1f98ca83-f9d0-4efb-9d73-5fe76acf4836 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:32:26.182045 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-1f98ca83-f9d0-4efb-9d73-5fe76acf4836 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] [instance: c547ded0-7a14-4d94-b2e2-0434481aaa17] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:32:26.195529 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-1f98ca83-f9d0-4efb-9d73-5fe76acf4836 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:32:26.196668 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-1f98ca83-f9d0-4efb-9d73-5fe76acf4836 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:32:26.198426 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-1f98ca83-f9d0-4efb-9d73-5fe76acf4836 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:32:26.200176 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-1f98ca83-f9d0-4efb-9d73-5fe76acf4836 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:32:26.236221 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-bfed8302-cc5e-46e1-a676-dc2deb704d83 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:32:26.245213 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-1f98ca83-f9d0-4efb-9d73-5fe76acf4836 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] [instance: c547ded0-7a14-4d94-b2e2-0434481aaa17] Going to try to terminate instance {{(pid=117987) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 13:32:26.246189 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-bfed8302-cc5e-46e1-a676-dc2deb704d83 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:32:26.247830 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-bfed8302-cc5e-46e1-a676-dc2deb704d83 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:32:26.248992 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-bfed8302-cc5e-46e1-a676-dc2deb704d83 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f" status: 200 len: 1753 microversion: 2.20 time: 0.442487 Jul 12 13:32:26.250196 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 245/482] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:32:25 2022] GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f => generated 1753 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:32:26.348347 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-1f98ca83-f9d0-4efb-9d73-5fe76acf4836 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c547ded0-7a14-4d94-b2e2-0434481aaa17" status: 204 len: 0 microversion: 2.1 time: 0.170782 Jul 12 13:32:26.348965 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 238/483] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 12 13:32:26 2022] DELETE /compute/v2.1/servers/c547ded0-7a14-4d94-b2e2-0434481aaa17 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 13:32:26.359994 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-a696790d-35a0-4502-8b8c-ebc9c42db388 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:32:26.360635 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-a696790d-35a0-4502-8b8c-ebc9c42db388 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] [instance: c547ded0-7a14-4d94-b2e2-0434481aaa17] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:32:26.366899 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-a696790d-35a0-4502-8b8c-ebc9c42db388 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:32:26.367732 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-a696790d-35a0-4502-8b8c-ebc9c42db388 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:32:26.369059 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-a696790d-35a0-4502-8b8c-ebc9c42db388 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:32:26.369717 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-a696790d-35a0-4502-8b8c-ebc9c42db388 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:32:26.503969 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-a696790d-35a0-4502-8b8c-ebc9c42db388 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd582e9b7a49c4ea6b9a1d6986d6f4163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86acb815cd62409d9856563af3037d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:32:26.511378 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-a696790d-35a0-4502-8b8c-ebc9c42db388 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] 10.222.0.23 "GET /compute/v2.1/servers/c547ded0-7a14-4d94-b2e2-0434481aaa17" status: 200 len: 1513 microversion: 2.1 time: 0.155940 Jul 12 13:32:26.512162 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 246/484] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:32:26 2022] GET /compute/v2.1/servers/c547ded0-7a14-4d94-b2e2-0434481aaa17 => generated 1513 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:32:27.269164 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-30e96d61-79bf-4f9c-b378-45ed44da705f tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:32:27.269889 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-30e96d61-79bf-4f9c-b378-45ed44da705f tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 5d30ed54-909d-491f-a14c-bc4435cfdc6f] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:32:27.276456 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-30e96d61-79bf-4f9c-b378-45ed44da705f tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:32:27.276993 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-30e96d61-79bf-4f9c-b378-45ed44da705f tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:32:27.278473 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-30e96d61-79bf-4f9c-b378-45ed44da705f tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:32:27.278900 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-30e96d61-79bf-4f9c-b378-45ed44da705f tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:32:27.415740 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-30e96d61-79bf-4f9c-b378-45ed44da705f tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:32:27.425019 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-30e96d61-79bf-4f9c-b378-45ed44da705f tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:32:27.426603 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-30e96d61-79bf-4f9c-b378-45ed44da705f tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:32:27.427766 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-30e96d61-79bf-4f9c-b378-45ed44da705f tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f" status: 200 len: 1753 microversion: 2.20 time: 0.162847 Jul 12 13:32:27.428336 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 239/485] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:32:27 2022] GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f => generated 1753 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:32:27.529537 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-2ff304b5-fac8-4836-a331-3745742c538e tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:32:27.530082 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-2ff304b5-fac8-4836-a331-3745742c538e tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] [instance: c547ded0-7a14-4d94-b2e2-0434481aaa17] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:32:27.536457 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-2ff304b5-fac8-4836-a331-3745742c538e tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:32:27.536899 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-2ff304b5-fac8-4836-a331-3745742c538e tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:32:27.537800 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-2ff304b5-fac8-4836-a331-3745742c538e tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:32:27.538229 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-2ff304b5-fac8-4836-a331-3745742c538e tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:32:27.668964 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-2ff304b5-fac8-4836-a331-3745742c538e tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd582e9b7a49c4ea6b9a1d6986d6f4163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86acb815cd62409d9856563af3037d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:32:27.676475 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-2ff304b5-fac8-4836-a331-3745742c538e tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] 10.222.0.23 "GET /compute/v2.1/servers/c547ded0-7a14-4d94-b2e2-0434481aaa17" status: 200 len: 1513 microversion: 2.1 time: 0.151225 Jul 12 13:32:27.677043 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 247/486] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:32:27 2022] GET /compute/v2.1/servers/c547ded0-7a14-4d94-b2e2-0434481aaa17 => generated 1513 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:32:28.446919 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-8dc87a78-0166-4000-80c6-0ee2c3a30c1e tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:32:28.447536 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-8dc87a78-0166-4000-80c6-0ee2c3a30c1e tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 5d30ed54-909d-491f-a14c-bc4435cfdc6f] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:32:28.454803 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-8dc87a78-0166-4000-80c6-0ee2c3a30c1e tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:32:28.455249 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-8dc87a78-0166-4000-80c6-0ee2c3a30c1e tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:32:28.456017 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-8dc87a78-0166-4000-80c6-0ee2c3a30c1e tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:32:28.456449 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-8dc87a78-0166-4000-80c6-0ee2c3a30c1e tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:32:28.597313 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-8dc87a78-0166-4000-80c6-0ee2c3a30c1e tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:32:28.612792 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-8dc87a78-0166-4000-80c6-0ee2c3a30c1e tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:32:28.614563 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-8dc87a78-0166-4000-80c6-0ee2c3a30c1e tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:32:28.615753 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-8dc87a78-0166-4000-80c6-0ee2c3a30c1e tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f" status: 200 len: 1809 microversion: 2.20 time: 0.172769 Jul 12 13:32:28.616320 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 240/487] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:32:28 2022] GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f => generated 1809 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:32:28.694491 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-08026204-f986-41d1-86ec-82c26baf3243 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:32:28.695093 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-08026204-f986-41d1-86ec-82c26baf3243 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] [instance: c547ded0-7a14-4d94-b2e2-0434481aaa17] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:32:28.701851 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-08026204-f986-41d1-86ec-82c26baf3243 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:32:28.702297 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-08026204-f986-41d1-86ec-82c26baf3243 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:32:28.703689 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-08026204-f986-41d1-86ec-82c26baf3243 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:32:28.704212 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-08026204-f986-41d1-86ec-82c26baf3243 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:32:28.913029 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-08026204-f986-41d1-86ec-82c26baf3243 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd582e9b7a49c4ea6b9a1d6986d6f4163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86acb815cd62409d9856563af3037d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:32:28.925048 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-08026204-f986-41d1-86ec-82c26baf3243 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] 10.222.0.23 "GET /compute/v2.1/servers/c547ded0-7a14-4d94-b2e2-0434481aaa17" status: 200 len: 1513 microversion: 2.1 time: 0.234346 Jul 12 13:32:28.926089 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 248/488] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:32:28 2022] GET /compute/v2.1/servers/c547ded0-7a14-4d94-b2e2-0434481aaa17 => generated 1513 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:32:29.317036 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [req-877f99ae-80b4-4a73-94ce-24213d98175b req-75b73a22-5957-44bb-85a1-83dfd69a1bca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c547ded0-7a14-4d94-b2e2-0434481aaa17", "name": "network-vif-deleted", "tag": "41de46ac-579d-47d3-a5c1-4f8443756768"}]} {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:32:29.326349 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [req-877f99ae-80b4-4a73-94ce-24213d98175b req-75b73a22-5957-44bb-85a1-83dfd69a1bca service nova] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:32:29.326790 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [req-877f99ae-80b4-4a73-94ce-24213d98175b req-75b73a22-5957-44bb-85a1-83dfd69a1bca service nova] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:32:29.338670 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.compute.server_external_events [req-877f99ae-80b4-4a73-94ce-24213d98175b req-75b73a22-5957-44bb-85a1-83dfd69a1bca service nova] Creating event network-vif-deleted:41de46ac-579d-47d3-a5c1-4f8443756768 for instance c547ded0-7a14-4d94-b2e2-0434481aaa17 on hv-cinder-82002 Jul 12 13:32:29.344619 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [req-877f99ae-80b4-4a73-94ce-24213d98175b req-75b73a22-5957-44bb-85a1-83dfd69a1bca service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031372 Jul 12 13:32:29.345434 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 241/489] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 12 13:32:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:32:29.635365 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-907f84bc-e71d-411f-a13c-e725208bd0dc tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:32:29.635878 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-907f84bc-e71d-411f-a13c-e725208bd0dc tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 5d30ed54-909d-491f-a14c-bc4435cfdc6f] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:32:29.642296 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-907f84bc-e71d-411f-a13c-e725208bd0dc tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:32:29.642743 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-907f84bc-e71d-411f-a13c-e725208bd0dc tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:32:29.643506 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-907f84bc-e71d-411f-a13c-e725208bd0dc tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:32:29.643934 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-907f84bc-e71d-411f-a13c-e725208bd0dc tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:32:29.777416 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-907f84bc-e71d-411f-a13c-e725208bd0dc tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:32:29.787222 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-907f84bc-e71d-411f-a13c-e725208bd0dc tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:32:29.788747 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-907f84bc-e71d-411f-a13c-e725208bd0dc tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:32:29.789962 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-907f84bc-e71d-411f-a13c-e725208bd0dc tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f" status: 200 len: 1809 microversion: 2.20 time: 0.158589 Jul 12 13:32:29.790517 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 249/490] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:32:29 2022] GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f => generated 1809 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:32:29.943649 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-e46f915f-ae94-415c-b3e4-d268d1eccf33 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:32:29.944505 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-e46f915f-ae94-415c-b3e4-d268d1eccf33 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] [instance: c547ded0-7a14-4d94-b2e2-0434481aaa17] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:32:29.951941 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-e46f915f-ae94-415c-b3e4-d268d1eccf33 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:32:29.952658 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-e46f915f-ae94-415c-b3e4-d268d1eccf33 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:32:29.953557 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-e46f915f-ae94-415c-b3e4-d268d1eccf33 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:32:29.953980 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-e46f915f-ae94-415c-b3e4-d268d1eccf33 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:32:29.989419 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-e46f915f-ae94-415c-b3e4-d268d1eccf33 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:32:29.990147 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-e46f915f-ae94-415c-b3e4-d268d1eccf33 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:32:29.990604 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.objects.instance [None req-e46f915f-ae94-415c-b3e4-d268d1eccf33 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lazy-loading 'fault' on Instance uuid c547ded0-7a14-4d94-b2e2-0434481aaa17 {{(pid=117987) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 13:32:30.045319 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-e46f915f-ae94-415c-b3e4-d268d1eccf33 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd582e9b7a49c4ea6b9a1d6986d6f4163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86acb815cd62409d9856563af3037d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:32:30.052594 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-e46f915f-ae94-415c-b3e4-d268d1eccf33 tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] 10.222.0.23 "GET /compute/v2.1/servers/c547ded0-7a14-4d94-b2e2-0434481aaa17" status: 200 len: 1309 microversion: 2.1 time: 0.113784 Jul 12 13:32:30.053505 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 242/491] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:32:29 2022] GET /compute/v2.1/servers/c547ded0-7a14-4d94-b2e2-0434481aaa17 => generated 1309 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:32:30.808837 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-b93006c3-91a0-4318-ac5f-d74a48f4240b tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:32:30.809469 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-b93006c3-91a0-4318-ac5f-d74a48f4240b tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 5d30ed54-909d-491f-a14c-bc4435cfdc6f] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:32:30.816382 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-b93006c3-91a0-4318-ac5f-d74a48f4240b tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:32:30.816835 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-b93006c3-91a0-4318-ac5f-d74a48f4240b tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:32:30.817637 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-b93006c3-91a0-4318-ac5f-d74a48f4240b tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:32:30.818073 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-b93006c3-91a0-4318-ac5f-d74a48f4240b tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:32:30.958651 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-b93006c3-91a0-4318-ac5f-d74a48f4240b tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:32:30.968836 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-b93006c3-91a0-4318-ac5f-d74a48f4240b tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:32:30.970394 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-b93006c3-91a0-4318-ac5f-d74a48f4240b tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:32:30.971566 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-b93006c3-91a0-4318-ac5f-d74a48f4240b tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f" status: 200 len: 1809 microversion: 2.20 time: 0.167089 Jul 12 13:32:30.972141 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 250/492] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:32:30 2022] GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f => generated 1809 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:32:31.071563 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-8b497477-9f68-4cd8-ac79-78e757e4284f tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:32:31.072323 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-8b497477-9f68-4cd8-ac79-78e757e4284f tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] [instance: c547ded0-7a14-4d94-b2e2-0434481aaa17] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:32:31.079208 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-8b497477-9f68-4cd8-ac79-78e757e4284f tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:32:31.079648 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-8b497477-9f68-4cd8-ac79-78e757e4284f tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:32:31.080404 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-8b497477-9f68-4cd8-ac79-78e757e4284f tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:32:31.080859 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-8b497477-9f68-4cd8-ac79-78e757e4284f tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:32:31.095117 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.wsgi [None req-8b497477-9f68-4cd8-ac79-78e757e4284f tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] HTTP exception thrown: Instance c547ded0-7a14-4d94-b2e2-0434481aaa17 could not be found. Jul 12 13:32:31.096789 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-8b497477-9f68-4cd8-ac79-78e757e4284f tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Request method failure captured: Jul 12 13:32:31.096789 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: request: GET /compute/v2.1/servers/c547ded0-7a14-4d94-b2e2-0434481aaa17 HTTP/1.1 Jul 12 13:32:31.096789 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: Accept: application/json Jul 12 13:32:31.096789 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: Accept-Encoding: identity Jul 12 13:32:31.096789 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: Connection: close Jul 12 13:32:31.096789 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: Content-Length: 0 Jul 12 13:32:31.096789 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: Content-Type: application/json Jul 12 13:32:31.096789 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: Host: 10.222.0.23 Jul 12 13:32:31.096789 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: Openstack-System-Scope: None Jul 12 13:32:31.096789 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: User-Agent: python-urllib3/1.26.9 Jul 12 13:32:31.096789 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Auth-Token: gAAAAABizXcvP8yOYJDtE0nLNZQREhEA0hriD0_gfcsEWud2qhed-jMHrYhVqNU7GmpvISg6aHk-KX_t3II-lEr0ucG79Cxtk5XD6FJlhNV1fuLo0bWxzr-_XodVr64SP9qCIdnRJThO31pEpdj8fgzGkDWAsmRYXd69dDmSJwIt4mjxzjjKg9Y Jul 12 13:32:31.096789 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Domain-Id: None Jul 12 13:32:31.096789 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Domain-Name: None Jul 12 13:32:31.096789 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Identity-Status: Confirmed Jul 12 13:32:31.096789 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Is-Admin-Project: True Jul 12 13:32:31.096789 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Project-Domain-Id: default Jul 12 13:32:31.096789 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Project-Domain-Name: Default Jul 12 13:32:31.096789 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Project-Id: 86acb815cd62409d9856563af3037d38 Jul 12 13:32:31.096789 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Project-Name: tempest-VolumesSnapshotTestJSON-219654305 Jul 12 13:32:31.096789 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Role: reader,member Jul 12 13:32:31.096789 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Roles: reader,member Jul 12 13:32:31.098467 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/86acb815cd62409d9856563af3037d38"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_86acb815cd62409d9856563af3037d38", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/86acb815cd62409d9856563af3037d38"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/86acb815cd62409d9856563af3037d38"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] Jul 12 13:32:31.098467 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Tenant: tempest-VolumesSnapshotTestJSON-219654305 Jul 12 13:32:31.098467 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Tenant-Id: 86acb815cd62409d9856563af3037d38 Jul 12 13:32:31.098467 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-219654305 Jul 12 13:32:31.098467 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-User: tempest-VolumesSnapshotTestJSON-219654305-project Jul 12 13:32:31.098467 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-User-Domain-Id: default Jul 12 13:32:31.098467 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-User-Domain-Name: Default Jul 12 13:32:31.098467 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-User-Id: d582e9b7a49c4ea6b9a1d6986d6f4163 Jul 12 13:32:31.098467 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-User-Name: tempest-VolumesSnapshotTestJSON-219654305-project Jul 12 13:32:31.098467 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: method: > Jul 12 13:32:31.098467 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: exception: Instance c547ded0-7a14-4d94-b2e2-0434481aaa17 could not be found. Jul 12 13:32:31.098467 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: action_args: {'id': 'c547ded0-7a14-4d94-b2e2-0434481aaa17'} Jul 12 13:32:31.099283 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 13:32:31.099283 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:32:31.099283 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 13:32:31.099283 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 13:32:31.099283 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 13:32:31.099283 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 13:32:31.099283 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 13:32:31.099283 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 13:32:31.099283 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 13:32:31.099283 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 13:32:31.099283 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c547ded0-7a14-4d94-b2e2-0434481aaa17 could not be found. Jul 12 13:32:31.099283 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi Jul 12 13:32:31.099283 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:32:31.099283 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi Jul 12 13:32:31.099283 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:32:31.099283 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:32:31.099283 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:32:31.099283 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 13:32:31.099283 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 13:32:31.099283 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 13:32:31.100875 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:32:31.100875 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 13:32:31.100875 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 13:32:31.100875 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 13:32:31.100875 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 13:32:31.100875 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 13:32:31.100875 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 13:32:31.100875 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c547ded0-7a14-4d94-b2e2-0434481aaa17 could not be found. Jul 12 13:32:31.100875 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi Jul 12 13:32:31.100875 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:32:31.100875 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi Jul 12 13:32:31.100875 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:32:31.100875 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:32:31.100875 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:32:31.100875 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 13:32:31.100875 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 13:32:31.100875 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c547ded0-7a14-4d94-b2e2-0434481aaa17 could not be found. Jul 12 13:32:31.100875 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi Jul 12 13:32:31.102194 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-8b497477-9f68-4cd8-ac79-78e757e4284f tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] Returning 404 to user: Instance c547ded0-7a14-4d94-b2e2-0434481aaa17 could not be found. {{(pid=117987) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 13:32:31.102194 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-8b497477-9f68-4cd8-ac79-78e757e4284f tempest-VolumesSnapshotTestJSON-219654305 tempest-VolumesSnapshotTestJSON-219654305-project] 10.222.0.23 "GET /compute/v2.1/servers/c547ded0-7a14-4d94-b2e2-0434481aaa17" status: 404 len: 111 microversion: 2.1 time: 0.030827 Jul 12 13:32:31.102194 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 243/493] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:32:31 2022] GET /compute/v2.1/servers/c547ded0-7a14-4d94-b2e2-0434481aaa17 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 13:32:31.990298 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-ab42b54a-9d19-4671-9d27-b37a9f41e316 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:32:31.990988 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-ab42b54a-9d19-4671-9d27-b37a9f41e316 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 5d30ed54-909d-491f-a14c-bc4435cfdc6f] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:32:31.998435 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-ab42b54a-9d19-4671-9d27-b37a9f41e316 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:32:31.998887 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-ab42b54a-9d19-4671-9d27-b37a9f41e316 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:32:31.999672 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-ab42b54a-9d19-4671-9d27-b37a9f41e316 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:32:32.000239 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-ab42b54a-9d19-4671-9d27-b37a9f41e316 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:32:32.140431 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-ab42b54a-9d19-4671-9d27-b37a9f41e316 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:32:32.149208 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-ab42b54a-9d19-4671-9d27-b37a9f41e316 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:32:32.150735 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-ab42b54a-9d19-4671-9d27-b37a9f41e316 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:32:32.152429 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-ab42b54a-9d19-4671-9d27-b37a9f41e316 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f" status: 200 len: 1809 microversion: 2.20 time: 0.165513 Jul 12 13:32:32.152985 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 251/494] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:32:31 2022] GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f => generated 1809 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:32:33.171011 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-e28a2248-fb23-4e7b-a1a6-4bad373c72b7 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:32:33.171603 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-e28a2248-fb23-4e7b-a1a6-4bad373c72b7 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 5d30ed54-909d-491f-a14c-bc4435cfdc6f] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:32:33.178853 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-e28a2248-fb23-4e7b-a1a6-4bad373c72b7 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:32:33.179297 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-e28a2248-fb23-4e7b-a1a6-4bad373c72b7 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:32:33.180073 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-e28a2248-fb23-4e7b-a1a6-4bad373c72b7 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:32:33.180506 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-e28a2248-fb23-4e7b-a1a6-4bad373c72b7 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:32:33.369746 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-e28a2248-fb23-4e7b-a1a6-4bad373c72b7 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:32:33.380314 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-e28a2248-fb23-4e7b-a1a6-4bad373c72b7 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:32:33.382160 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-e28a2248-fb23-4e7b-a1a6-4bad373c72b7 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:32:33.383332 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-e28a2248-fb23-4e7b-a1a6-4bad373c72b7 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f" status: 200 len: 1809 microversion: 2.20 time: 0.216397 Jul 12 13:32:33.383892 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 244/495] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:32:33 2022] GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f => generated 1809 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:32:33.908838 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 12 13:32:33.909494 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: Tue Jul 12 13:32:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 12 13:32:34.403160 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-a2b1dcc1-4f70-4be4-94e1-324dc329dc3e tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:32:34.403768 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-a2b1dcc1-4f70-4be4-94e1-324dc329dc3e tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 5d30ed54-909d-491f-a14c-bc4435cfdc6f] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:32:34.406226 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG dbcounter [-] [117988] Writing DB stats nova_api:SELECT=36 {{(pid=117988) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:32:34.411998 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-a2b1dcc1-4f70-4be4-94e1-324dc329dc3e tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:32:34.412470 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-a2b1dcc1-4f70-4be4-94e1-324dc329dc3e tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:32:34.413228 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-a2b1dcc1-4f70-4be4-94e1-324dc329dc3e tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:32:34.413678 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-a2b1dcc1-4f70-4be4-94e1-324dc329dc3e tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:32:34.547846 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-a2b1dcc1-4f70-4be4-94e1-324dc329dc3e tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:32:34.556502 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-a2b1dcc1-4f70-4be4-94e1-324dc329dc3e tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:32:34.558189 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-a2b1dcc1-4f70-4be4-94e1-324dc329dc3e tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:32:34.559338 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-a2b1dcc1-4f70-4be4-94e1-324dc329dc3e tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f" status: 200 len: 1809 microversion: 2.20 time: 0.160762 Jul 12 13:32:34.559901 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 252/496] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:32:34 2022] GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f => generated 1809 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 13:32:35.578870 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-0a60eb48-bec6-41ed-822e-fefd776d5949 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:32:35.579805 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-0a60eb48-bec6-41ed-822e-fefd776d5949 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 5d30ed54-909d-491f-a14c-bc4435cfdc6f] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:32:35.586806 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-0a60eb48-bec6-41ed-822e-fefd776d5949 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:32:35.587287 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-0a60eb48-bec6-41ed-822e-fefd776d5949 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:32:35.588034 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-0a60eb48-bec6-41ed-822e-fefd776d5949 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:32:35.588671 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-0a60eb48-bec6-41ed-822e-fefd776d5949 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:32:35.744771 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-0a60eb48-bec6-41ed-822e-fefd776d5949 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:32:35.754201 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-0a60eb48-bec6-41ed-822e-fefd776d5949 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:32:35.755739 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-0a60eb48-bec6-41ed-822e-fefd776d5949 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:32:35.756922 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-0a60eb48-bec6-41ed-822e-fefd776d5949 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f" status: 200 len: 1809 microversion: 2.20 time: 0.183145 Jul 12 13:32:35.760176 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 245/497] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:32:35 2022] GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f => generated 1809 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:32:36.782717 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-3a8daac5-6dbf-4be8-aec5-1e1d9c9dfc8e tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:32:36.783358 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-3a8daac5-6dbf-4be8-aec5-1e1d9c9dfc8e tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 5d30ed54-909d-491f-a14c-bc4435cfdc6f] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:32:36.790197 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-3a8daac5-6dbf-4be8-aec5-1e1d9c9dfc8e tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:32:36.790642 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-3a8daac5-6dbf-4be8-aec5-1e1d9c9dfc8e tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:32:36.791420 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-3a8daac5-6dbf-4be8-aec5-1e1d9c9dfc8e tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:32:36.791843 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-3a8daac5-6dbf-4be8-aec5-1e1d9c9dfc8e tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:32:36.954700 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-3a8daac5-6dbf-4be8-aec5-1e1d9c9dfc8e tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:32:36.967044 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-3a8daac5-6dbf-4be8-aec5-1e1d9c9dfc8e tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:32:36.968628 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-3a8daac5-6dbf-4be8-aec5-1e1d9c9dfc8e tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:32:36.969816 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-3a8daac5-6dbf-4be8-aec5-1e1d9c9dfc8e tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f" status: 200 len: 1809 microversion: 2.20 time: 0.191050 Jul 12 13:32:36.970363 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 253/498] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:32:36 2022] GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f => generated 1809 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:32:37.990330 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-3b9cd636-24fb-43f0-be9a-708a002ebbab tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:32:37.990982 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-3b9cd636-24fb-43f0-be9a-708a002ebbab tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 5d30ed54-909d-491f-a14c-bc4435cfdc6f] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:32:37.998194 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-3b9cd636-24fb-43f0-be9a-708a002ebbab tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:32:37.998640 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-3b9cd636-24fb-43f0-be9a-708a002ebbab tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:32:37.999468 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-3b9cd636-24fb-43f0-be9a-708a002ebbab tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:32:37.999846 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-3b9cd636-24fb-43f0-be9a-708a002ebbab tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:32:38.152188 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-3b9cd636-24fb-43f0-be9a-708a002ebbab tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:32:38.160914 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-3b9cd636-24fb-43f0-be9a-708a002ebbab tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:32:38.162451 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-3b9cd636-24fb-43f0-be9a-708a002ebbab tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:32:38.163598 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-3b9cd636-24fb-43f0-be9a-708a002ebbab tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f" status: 200 len: 1809 microversion: 2.20 time: 0.177137 Jul 12 13:32:38.164165 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 246/499] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:32:37 2022] GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f => generated 1809 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:32:39.182723 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-0cfa2bc4-becf-4aa7-912d-6ac67bdb68f0 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:32:39.183291 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-0cfa2bc4-becf-4aa7-912d-6ac67bdb68f0 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 5d30ed54-909d-491f-a14c-bc4435cfdc6f] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:32:39.190923 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-0cfa2bc4-becf-4aa7-912d-6ac67bdb68f0 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:32:39.191416 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-0cfa2bc4-becf-4aa7-912d-6ac67bdb68f0 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:32:39.192132 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-0cfa2bc4-becf-4aa7-912d-6ac67bdb68f0 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:32:39.192560 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-0cfa2bc4-becf-4aa7-912d-6ac67bdb68f0 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:32:39.336486 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-0cfa2bc4-becf-4aa7-912d-6ac67bdb68f0 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:32:39.346514 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-0cfa2bc4-becf-4aa7-912d-6ac67bdb68f0 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:32:39.348031 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-0cfa2bc4-becf-4aa7-912d-6ac67bdb68f0 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:32:39.349200 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-0cfa2bc4-becf-4aa7-912d-6ac67bdb68f0 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f" status: 200 len: 1809 microversion: 2.20 time: 0.170538 Jul 12 13:32:39.349854 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 254/500] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:32:39 2022] GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f => generated 1809 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:32:40.371458 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-f53c8daf-48ec-4d9a-b7b0-3c2ae346a76f tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:32:40.372751 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-f53c8daf-48ec-4d9a-b7b0-3c2ae346a76f tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 5d30ed54-909d-491f-a14c-bc4435cfdc6f] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:32:40.376637 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG dbcounter [-] [117987] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1 {{(pid=117987) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:32:40.382211 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-f53c8daf-48ec-4d9a-b7b0-3c2ae346a76f tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:32:40.382815 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-f53c8daf-48ec-4d9a-b7b0-3c2ae346a76f tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:32:40.383606 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-f53c8daf-48ec-4d9a-b7b0-3c2ae346a76f tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:32:40.384051 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-f53c8daf-48ec-4d9a-b7b0-3c2ae346a76f tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:32:40.530036 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-f53c8daf-48ec-4d9a-b7b0-3c2ae346a76f tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:32:40.540751 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-f53c8daf-48ec-4d9a-b7b0-3c2ae346a76f tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:32:40.542499 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-f53c8daf-48ec-4d9a-b7b0-3c2ae346a76f tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:32:40.544551 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-f53c8daf-48ec-4d9a-b7b0-3c2ae346a76f tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f" status: 200 len: 1809 microversion: 2.20 time: 0.177857 Jul 12 13:32:40.545109 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 247/501] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:32:40 2022] GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f => generated 1809 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:32:41.562474 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-884f9a2e-cbbe-4549-815a-ff9ffd1c4b77 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:32:41.563163 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-884f9a2e-cbbe-4549-815a-ff9ffd1c4b77 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 5d30ed54-909d-491f-a14c-bc4435cfdc6f] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:32:41.569880 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-884f9a2e-cbbe-4549-815a-ff9ffd1c4b77 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:32:41.570324 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-884f9a2e-cbbe-4549-815a-ff9ffd1c4b77 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:32:41.571075 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-884f9a2e-cbbe-4549-815a-ff9ffd1c4b77 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:32:41.571503 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-884f9a2e-cbbe-4549-815a-ff9ffd1c4b77 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:32:41.574011 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG dbcounter [-] [117988] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=117988) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:32:41.735391 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-884f9a2e-cbbe-4549-815a-ff9ffd1c4b77 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:32:41.749578 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-884f9a2e-cbbe-4549-815a-ff9ffd1c4b77 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:32:41.752042 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-884f9a2e-cbbe-4549-815a-ff9ffd1c4b77 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:32:41.754367 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-884f9a2e-cbbe-4549-815a-ff9ffd1c4b77 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f" status: 200 len: 1809 microversion: 2.20 time: 0.195745 Jul 12 13:32:41.755428 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 255/502] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:32:41 2022] GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f => generated 1809 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:32:42.773348 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-5209b15d-80e1-453b-bbb7-438dd4bce314 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:32:42.774003 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-5209b15d-80e1-453b-bbb7-438dd4bce314 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 5d30ed54-909d-491f-a14c-bc4435cfdc6f] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:32:42.780957 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-5209b15d-80e1-453b-bbb7-438dd4bce314 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:32:42.781499 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-5209b15d-80e1-453b-bbb7-438dd4bce314 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:32:42.782410 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-5209b15d-80e1-453b-bbb7-438dd4bce314 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:32:42.782859 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-5209b15d-80e1-453b-bbb7-438dd4bce314 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:32:42.803084 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG dbcounter [-] [117987] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=117987) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:32:42.953275 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-5209b15d-80e1-453b-bbb7-438dd4bce314 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:32:42.962838 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-5209b15d-80e1-453b-bbb7-438dd4bce314 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:32:42.964328 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-5209b15d-80e1-453b-bbb7-438dd4bce314 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:32:42.965739 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-5209b15d-80e1-453b-bbb7-438dd4bce314 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f" status: 200 len: 1809 microversion: 2.20 time: 0.196533 Jul 12 13:32:42.966299 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 248/503] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:32:42 2022] GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f => generated 1809 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:32:43.984176 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-2663c141-7d32-416f-beeb-730e313aae93 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:32:43.984888 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-2663c141-7d32-416f-beeb-730e313aae93 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 5d30ed54-909d-491f-a14c-bc4435cfdc6f] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:32:43.991667 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-2663c141-7d32-416f-beeb-730e313aae93 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:32:43.992111 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-2663c141-7d32-416f-beeb-730e313aae93 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:32:43.992874 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-2663c141-7d32-416f-beeb-730e313aae93 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:32:43.993300 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-2663c141-7d32-416f-beeb-730e313aae93 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:32:44.132189 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-2663c141-7d32-416f-beeb-730e313aae93 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:32:44.150093 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-2663c141-7d32-416f-beeb-730e313aae93 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:32:44.151598 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-2663c141-7d32-416f-beeb-730e313aae93 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:32:44.153579 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-2663c141-7d32-416f-beeb-730e313aae93 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f" status: 200 len: 1809 microversion: 2.20 time: 0.173566 Jul 12 13:32:44.154131 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 256/504] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:32:43 2022] GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f => generated 1809 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:32:45.171675 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-66a3ff0d-93e3-42b8-a5dd-b9cefad6331b tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:32:45.172273 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-66a3ff0d-93e3-42b8-a5dd-b9cefad6331b tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 5d30ed54-909d-491f-a14c-bc4435cfdc6f] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:32:45.178672 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-66a3ff0d-93e3-42b8-a5dd-b9cefad6331b tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:32:45.179116 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-66a3ff0d-93e3-42b8-a5dd-b9cefad6331b tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:32:45.179873 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-66a3ff0d-93e3-42b8-a5dd-b9cefad6331b tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:32:45.180307 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-66a3ff0d-93e3-42b8-a5dd-b9cefad6331b tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:32:45.315576 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-66a3ff0d-93e3-42b8-a5dd-b9cefad6331b tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:32:45.323929 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-66a3ff0d-93e3-42b8-a5dd-b9cefad6331b tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:32:45.326108 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-66a3ff0d-93e3-42b8-a5dd-b9cefad6331b tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:32:45.327284 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-66a3ff0d-93e3-42b8-a5dd-b9cefad6331b tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f" status: 200 len: 1809 microversion: 2.20 time: 0.159624 Jul 12 13:32:45.327840 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 249/505] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:32:45 2022] GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:32:46.346270 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-0d37c4d3-e40a-4def-8b43-d6c5f1f73630 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:32:46.346872 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-0d37c4d3-e40a-4def-8b43-d6c5f1f73630 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 5d30ed54-909d-491f-a14c-bc4435cfdc6f] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:32:46.353677 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-0d37c4d3-e40a-4def-8b43-d6c5f1f73630 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:32:46.354121 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-0d37c4d3-e40a-4def-8b43-d6c5f1f73630 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:32:46.355005 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-0d37c4d3-e40a-4def-8b43-d6c5f1f73630 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:32:46.355426 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-0d37c4d3-e40a-4def-8b43-d6c5f1f73630 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:32:46.490500 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-0d37c4d3-e40a-4def-8b43-d6c5f1f73630 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:32:46.500046 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-0d37c4d3-e40a-4def-8b43-d6c5f1f73630 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:32:46.501640 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-0d37c4d3-e40a-4def-8b43-d6c5f1f73630 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:32:46.502812 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-0d37c4d3-e40a-4def-8b43-d6c5f1f73630 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f" status: 200 len: 1809 microversion: 2.20 time: 0.160460 Jul 12 13:32:46.503397 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 257/506] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:32:46 2022] GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f => generated 1809 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 13:32:47.524078 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-6d12b7b9-ccbb-40ea-a5ed-eb5cff4221b9 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:32:47.524686 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-6d12b7b9-ccbb-40ea-a5ed-eb5cff4221b9 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 5d30ed54-909d-491f-a14c-bc4435cfdc6f] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:32:47.531563 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-6d12b7b9-ccbb-40ea-a5ed-eb5cff4221b9 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:32:47.532067 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-6d12b7b9-ccbb-40ea-a5ed-eb5cff4221b9 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:32:47.532838 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-6d12b7b9-ccbb-40ea-a5ed-eb5cff4221b9 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:32:47.533274 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-6d12b7b9-ccbb-40ea-a5ed-eb5cff4221b9 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:32:47.676908 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-6d12b7b9-ccbb-40ea-a5ed-eb5cff4221b9 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:32:47.685988 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-6d12b7b9-ccbb-40ea-a5ed-eb5cff4221b9 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:32:47.687514 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-6d12b7b9-ccbb-40ea-a5ed-eb5cff4221b9 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:32:47.688666 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-6d12b7b9-ccbb-40ea-a5ed-eb5cff4221b9 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f" status: 200 len: 1809 microversion: 2.20 time: 0.168554 Jul 12 13:32:47.689219 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 250/507] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:32:47 2022] GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f => generated 1809 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:32:48.707816 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-52515bf6-70ed-4e54-bd2d-515554719f65 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:32:48.708434 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-52515bf6-70ed-4e54-bd2d-515554719f65 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 5d30ed54-909d-491f-a14c-bc4435cfdc6f] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:32:48.715957 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-52515bf6-70ed-4e54-bd2d-515554719f65 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:32:48.716421 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-52515bf6-70ed-4e54-bd2d-515554719f65 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:32:48.717208 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-52515bf6-70ed-4e54-bd2d-515554719f65 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:32:48.717676 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-52515bf6-70ed-4e54-bd2d-515554719f65 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:32:48.860527 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-52515bf6-70ed-4e54-bd2d-515554719f65 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:32:48.869187 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-52515bf6-70ed-4e54-bd2d-515554719f65 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:32:48.870723 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-52515bf6-70ed-4e54-bd2d-515554719f65 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:32:48.872469 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-52515bf6-70ed-4e54-bd2d-515554719f65 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f" status: 200 len: 1809 microversion: 2.20 time: 0.168557 Jul 12 13:32:48.873034 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 258/508] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:32:48 2022] GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f => generated 1809 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:32:49.891597 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-79ddf70c-7719-4d75-a8dd-ac004d7ac7ef tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:32:49.892274 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-79ddf70c-7719-4d75-a8dd-ac004d7ac7ef tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 5d30ed54-909d-491f-a14c-bc4435cfdc6f] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:32:49.898950 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-79ddf70c-7719-4d75-a8dd-ac004d7ac7ef tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:32:49.899392 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-79ddf70c-7719-4d75-a8dd-ac004d7ac7ef tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:32:49.900182 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-79ddf70c-7719-4d75-a8dd-ac004d7ac7ef tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:32:49.900611 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-79ddf70c-7719-4d75-a8dd-ac004d7ac7ef tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:32:50.036522 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-79ddf70c-7719-4d75-a8dd-ac004d7ac7ef tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:32:50.046184 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-79ddf70c-7719-4d75-a8dd-ac004d7ac7ef tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:32:50.047692 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-79ddf70c-7719-4d75-a8dd-ac004d7ac7ef tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:32:50.048960 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-79ddf70c-7719-4d75-a8dd-ac004d7ac7ef tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f" status: 200 len: 1809 microversion: 2.20 time: 0.161504 Jul 12 13:32:50.049546 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 251/509] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:32:49 2022] GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f => generated 1809 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:32:51.068376 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-2bc688a3-419c-4ab9-907d-7b2819ee91c4 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:32:51.069002 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-2bc688a3-419c-4ab9-907d-7b2819ee91c4 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 5d30ed54-909d-491f-a14c-bc4435cfdc6f] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:32:51.076727 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-2bc688a3-419c-4ab9-907d-7b2819ee91c4 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:32:51.077174 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-2bc688a3-419c-4ab9-907d-7b2819ee91c4 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:32:51.077989 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-2bc688a3-419c-4ab9-907d-7b2819ee91c4 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:32:51.078424 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-2bc688a3-419c-4ab9-907d-7b2819ee91c4 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:32:51.223151 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-2bc688a3-419c-4ab9-907d-7b2819ee91c4 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:32:51.232138 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-2bc688a3-419c-4ab9-907d-7b2819ee91c4 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:32:51.233672 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-2bc688a3-419c-4ab9-907d-7b2819ee91c4 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:32:51.234831 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-2bc688a3-419c-4ab9-907d-7b2819ee91c4 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f" status: 200 len: 1809 microversion: 2.20 time: 0.170684 Jul 12 13:32:51.235382 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 259/510] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:32:51 2022] GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f => generated 1809 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:32:52.254147 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-1cafbcb3-1dbd-416d-84a3-57ca6e5e6813 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:32:52.254754 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-1cafbcb3-1dbd-416d-84a3-57ca6e5e6813 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 5d30ed54-909d-491f-a14c-bc4435cfdc6f] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:32:52.264554 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-1cafbcb3-1dbd-416d-84a3-57ca6e5e6813 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:32:52.264554 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-1cafbcb3-1dbd-416d-84a3-57ca6e5e6813 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:32:52.264554 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-1cafbcb3-1dbd-416d-84a3-57ca6e5e6813 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:32:52.264554 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-1cafbcb3-1dbd-416d-84a3-57ca6e5e6813 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:32:52.403729 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-1cafbcb3-1dbd-416d-84a3-57ca6e5e6813 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:32:52.412351 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-1cafbcb3-1dbd-416d-84a3-57ca6e5e6813 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:32:52.413895 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-1cafbcb3-1dbd-416d-84a3-57ca6e5e6813 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:32:52.415058 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-1cafbcb3-1dbd-416d-84a3-57ca6e5e6813 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f" status: 200 len: 1809 microversion: 2.20 time: 0.164810 Jul 12 13:32:52.415610 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 252/511] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:32:52 2022] GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f => generated 1809 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 13:32:53.433598 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-9a1a15b9-2660-43e7-809f-1cfb3fb92fa6 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:32:53.434149 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-9a1a15b9-2660-43e7-809f-1cfb3fb92fa6 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 5d30ed54-909d-491f-a14c-bc4435cfdc6f] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:32:53.441683 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-9a1a15b9-2660-43e7-809f-1cfb3fb92fa6 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:32:53.442126 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-9a1a15b9-2660-43e7-809f-1cfb3fb92fa6 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:32:53.442911 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-9a1a15b9-2660-43e7-809f-1cfb3fb92fa6 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:32:53.443328 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-9a1a15b9-2660-43e7-809f-1cfb3fb92fa6 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:32:53.582490 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-9a1a15b9-2660-43e7-809f-1cfb3fb92fa6 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:32:53.591352 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-9a1a15b9-2660-43e7-809f-1cfb3fb92fa6 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:32:53.592848 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-9a1a15b9-2660-43e7-809f-1cfb3fb92fa6 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:32:53.594051 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-9a1a15b9-2660-43e7-809f-1cfb3fb92fa6 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f" status: 200 len: 1809 microversion: 2.20 time: 0.164517 Jul 12 13:32:53.594615 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 260/512] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:32:53 2022] GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f => generated 1809 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:32:54.612901 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-ac605200-6b4c-465b-9a31-ee1ba34aa1db tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:32:54.613495 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-ac605200-6b4c-465b-9a31-ee1ba34aa1db tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 5d30ed54-909d-491f-a14c-bc4435cfdc6f] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:32:54.619975 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-ac605200-6b4c-465b-9a31-ee1ba34aa1db tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:32:54.620416 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-ac605200-6b4c-465b-9a31-ee1ba34aa1db tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:32:54.622209 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-ac605200-6b4c-465b-9a31-ee1ba34aa1db tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:32:54.622645 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-ac605200-6b4c-465b-9a31-ee1ba34aa1db tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:32:54.755833 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-ac605200-6b4c-465b-9a31-ee1ba34aa1db tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:32:54.765195 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-ac605200-6b4c-465b-9a31-ee1ba34aa1db tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:32:54.766759 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-ac605200-6b4c-465b-9a31-ee1ba34aa1db tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:32:54.767936 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-ac605200-6b4c-465b-9a31-ee1ba34aa1db tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f" status: 200 len: 1809 microversion: 2.20 time: 0.159013 Jul 12 13:32:54.768516 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 253/513] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:32:54 2022] GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f => generated 1809 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:32:55.788555 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-e4cc5ffd-b5e6-438e-ad15-52266a0eb2fe tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:32:55.789191 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-e4cc5ffd-b5e6-438e-ad15-52266a0eb2fe tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 5d30ed54-909d-491f-a14c-bc4435cfdc6f] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:32:55.796895 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-e4cc5ffd-b5e6-438e-ad15-52266a0eb2fe tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:32:55.797348 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-e4cc5ffd-b5e6-438e-ad15-52266a0eb2fe tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:32:55.798150 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-e4cc5ffd-b5e6-438e-ad15-52266a0eb2fe tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:32:55.798586 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-e4cc5ffd-b5e6-438e-ad15-52266a0eb2fe tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:32:55.931672 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-e4cc5ffd-b5e6-438e-ad15-52266a0eb2fe tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:32:55.940603 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-e4cc5ffd-b5e6-438e-ad15-52266a0eb2fe tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:32:55.942195 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-e4cc5ffd-b5e6-438e-ad15-52266a0eb2fe tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:32:55.943377 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-e4cc5ffd-b5e6-438e-ad15-52266a0eb2fe tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f" status: 200 len: 1809 microversion: 2.20 time: 0.158720 Jul 12 13:32:55.944020 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 261/514] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:32:55 2022] GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f => generated 1809 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:32:56.961464 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-a6834874-01d1-4e6a-8bcb-d0949f016f0e tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:32:56.962068 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-a6834874-01d1-4e6a-8bcb-d0949f016f0e tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 5d30ed54-909d-491f-a14c-bc4435cfdc6f] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:32:56.969287 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-a6834874-01d1-4e6a-8bcb-d0949f016f0e tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:32:56.969758 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-a6834874-01d1-4e6a-8bcb-d0949f016f0e tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:32:56.970652 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-a6834874-01d1-4e6a-8bcb-d0949f016f0e tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:32:56.971296 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-a6834874-01d1-4e6a-8bcb-d0949f016f0e tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:32:57.109119 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-a6834874-01d1-4e6a-8bcb-d0949f016f0e tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:32:57.117962 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-a6834874-01d1-4e6a-8bcb-d0949f016f0e tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:32:57.119475 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-a6834874-01d1-4e6a-8bcb-d0949f016f0e tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:32:57.120643 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-a6834874-01d1-4e6a-8bcb-d0949f016f0e tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f" status: 200 len: 1809 microversion: 2.20 time: 0.163211 Jul 12 13:32:57.121737 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 254/515] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:32:56 2022] GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f => generated 1809 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:32:58.141182 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-8766760a-f510-4384-b901-d815563c0158 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:32:58.141824 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-8766760a-f510-4384-b901-d815563c0158 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 5d30ed54-909d-491f-a14c-bc4435cfdc6f] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:32:58.148536 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-8766760a-f510-4384-b901-d815563c0158 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:32:58.149009 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-8766760a-f510-4384-b901-d815563c0158 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:32:58.149817 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-8766760a-f510-4384-b901-d815563c0158 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:32:58.150253 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-8766760a-f510-4384-b901-d815563c0158 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:32:58.307893 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-8766760a-f510-4384-b901-d815563c0158 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:32:58.317644 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-8766760a-f510-4384-b901-d815563c0158 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:32:58.319151 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-8766760a-f510-4384-b901-d815563c0158 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:32:58.320389 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-8766760a-f510-4384-b901-d815563c0158 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f" status: 200 len: 1809 microversion: 2.20 time: 0.183979 Jul 12 13:32:58.320879 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 262/516] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:32:58 2022] GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f => generated 1809 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:32:59.339209 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-383fa1b3-20f5-4166-8440-a46754afa473 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:32:59.340240 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-383fa1b3-20f5-4166-8440-a46754afa473 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 5d30ed54-909d-491f-a14c-bc4435cfdc6f] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:32:59.347306 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-383fa1b3-20f5-4166-8440-a46754afa473 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:32:59.347759 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-383fa1b3-20f5-4166-8440-a46754afa473 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:32:59.348530 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-383fa1b3-20f5-4166-8440-a46754afa473 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:32:59.348965 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-383fa1b3-20f5-4166-8440-a46754afa473 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:32:59.487776 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-383fa1b3-20f5-4166-8440-a46754afa473 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:32:59.496988 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-383fa1b3-20f5-4166-8440-a46754afa473 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:32:59.498538 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-383fa1b3-20f5-4166-8440-a46754afa473 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:32:59.499752 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-383fa1b3-20f5-4166-8440-a46754afa473 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f" status: 200 len: 1809 microversion: 2.20 time: 0.164397 Jul 12 13:32:59.500254 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 255/517] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:32:59 2022] GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f => generated 1809 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:33:00.519576 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-ec9b054d-46b8-4a56-a31b-68cf1e875197 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:33:00.520186 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-ec9b054d-46b8-4a56-a31b-68cf1e875197 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 5d30ed54-909d-491f-a14c-bc4435cfdc6f] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:33:00.526823 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-ec9b054d-46b8-4a56-a31b-68cf1e875197 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:33:00.527274 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-ec9b054d-46b8-4a56-a31b-68cf1e875197 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:33:00.528045 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-ec9b054d-46b8-4a56-a31b-68cf1e875197 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:33:00.528475 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-ec9b054d-46b8-4a56-a31b-68cf1e875197 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:33:00.661602 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-ec9b054d-46b8-4a56-a31b-68cf1e875197 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:33:00.670583 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-ec9b054d-46b8-4a56-a31b-68cf1e875197 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:33:00.672098 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-ec9b054d-46b8-4a56-a31b-68cf1e875197 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:33:00.673261 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-ec9b054d-46b8-4a56-a31b-68cf1e875197 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f" status: 200 len: 1809 microversion: 2.20 time: 0.157592 Jul 12 13:33:00.673861 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 263/518] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:33:00 2022] GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:33:01.693065 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-f87293a4-9b49-401e-a9d7-e0d81675d200 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:33:01.693711 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-f87293a4-9b49-401e-a9d7-e0d81675d200 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 5d30ed54-909d-491f-a14c-bc4435cfdc6f] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:33:01.700301 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-f87293a4-9b49-401e-a9d7-e0d81675d200 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:33:01.700755 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-f87293a4-9b49-401e-a9d7-e0d81675d200 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:33:01.701553 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-f87293a4-9b49-401e-a9d7-e0d81675d200 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:33:01.701989 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-f87293a4-9b49-401e-a9d7-e0d81675d200 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:33:01.844721 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-f87293a4-9b49-401e-a9d7-e0d81675d200 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:33:01.859445 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-f87293a4-9b49-401e-a9d7-e0d81675d200 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:33:01.862194 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-f87293a4-9b49-401e-a9d7-e0d81675d200 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:33:01.864126 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-f87293a4-9b49-401e-a9d7-e0d81675d200 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f" status: 200 len: 1809 microversion: 2.20 time: 0.175280 Jul 12 13:33:01.865032 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 256/519] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:33:01 2022] GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f => generated 1809 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:33:02.879556 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [req-bae9f802-0ce1-4aed-b61a-5ecb34fdc498 req-20d0c7cc-77e0-4883-8f66-143a93f5d60e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d30ed54-909d-491f-a14c-bc4435cfdc6f", "name": "network-vif-plugged", "status": "completed", "tag": "f13aa237-fefb-4e93-8923-7007031116c1"}]} {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:33:02.884874 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-70b39e88-74c9-4c62-8626-c8c32ddafab6 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:33:02.886140 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-70b39e88-74c9-4c62-8626-c8c32ddafab6 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 5d30ed54-909d-491f-a14c-bc4435cfdc6f] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:33:02.892050 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [req-bae9f802-0ce1-4aed-b61a-5ecb34fdc498 req-20d0c7cc-77e0-4883-8f66-143a93f5d60e service nova] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:33:02.892488 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [req-bae9f802-0ce1-4aed-b61a-5ecb34fdc498 req-20d0c7cc-77e0-4883-8f66-143a93f5d60e service nova] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:33:02.895818 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-70b39e88-74c9-4c62-8626-c8c32ddafab6 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:33:02.896661 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-70b39e88-74c9-4c62-8626-c8c32ddafab6 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:33:02.897944 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-70b39e88-74c9-4c62-8626-c8c32ddafab6 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:33:02.898579 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-70b39e88-74c9-4c62-8626-c8c32ddafab6 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:33:02.905506 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.compute.server_external_events [req-bae9f802-0ce1-4aed-b61a-5ecb34fdc498 req-20d0c7cc-77e0-4883-8f66-143a93f5d60e service nova] Creating event network-vif-plugged:f13aa237-fefb-4e93-8923-7007031116c1 for instance 5d30ed54-909d-491f-a14c-bc4435cfdc6f on hv-cinder-82002 Jul 12 13:33:02.910948 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [req-bae9f802-0ce1-4aed-b61a-5ecb34fdc498 req-20d0c7cc-77e0-4883-8f66-143a93f5d60e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036896 Jul 12 13:33:02.913028 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 264/520] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 12 13:33:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:33:03.069326 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-70b39e88-74c9-4c62-8626-c8c32ddafab6 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:33:03.081962 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-70b39e88-74c9-4c62-8626-c8c32ddafab6 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:33:03.083647 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-70b39e88-74c9-4c62-8626-c8c32ddafab6 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:33:03.085205 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-70b39e88-74c9-4c62-8626-c8c32ddafab6 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f" status: 200 len: 1809 microversion: 2.20 time: 0.205741 Jul 12 13:33:03.085882 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 257/521] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:33:02 2022] GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f => generated 1809 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 13:33:04.105256 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-337ff301-4359-4593-af23-92f26b7703b1 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:33:04.106066 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-337ff301-4359-4593-af23-92f26b7703b1 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 5d30ed54-909d-491f-a14c-bc4435cfdc6f] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:33:04.112425 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-337ff301-4359-4593-af23-92f26b7703b1 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:33:04.112940 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-337ff301-4359-4593-af23-92f26b7703b1 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:33:04.113690 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-337ff301-4359-4593-af23-92f26b7703b1 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:33:04.114130 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-337ff301-4359-4593-af23-92f26b7703b1 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:33:04.270230 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-337ff301-4359-4593-af23-92f26b7703b1 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:33:04.279489 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-337ff301-4359-4593-af23-92f26b7703b1 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:33:04.281357 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-337ff301-4359-4593-af23-92f26b7703b1 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:33:04.283034 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-337ff301-4359-4593-af23-92f26b7703b1 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f" status: 200 len: 1809 microversion: 2.20 time: 0.182545 Jul 12 13:33:04.283581 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 265/522] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:33:04 2022] GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f => generated 1809 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:33:05.306572 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-980aca06-3765-49c7-a713-73d874f2ebc0 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:33:05.308807 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-980aca06-3765-49c7-a713-73d874f2ebc0 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 5d30ed54-909d-491f-a14c-bc4435cfdc6f] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:33:05.318467 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-980aca06-3765-49c7-a713-73d874f2ebc0 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:33:05.320527 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-980aca06-3765-49c7-a713-73d874f2ebc0 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:33:05.321913 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-980aca06-3765-49c7-a713-73d874f2ebc0 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:33:05.322640 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-980aca06-3765-49c7-a713-73d874f2ebc0 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:33:05.626194 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-980aca06-3765-49c7-a713-73d874f2ebc0 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:33:05.636946 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-980aca06-3765-49c7-a713-73d874f2ebc0 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:33:05.638832 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-980aca06-3765-49c7-a713-73d874f2ebc0 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:33:05.640270 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-980aca06-3765-49c7-a713-73d874f2ebc0 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f" status: 200 len: 1809 microversion: 2.20 time: 0.340794 Jul 12 13:33:05.641413 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 258/523] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:33:05 2022] GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f => generated 1809 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:33:06.664293 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-a4f84f13-a0e0-42a1-bc68-e4baf153c3b3 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:33:06.666324 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-a4f84f13-a0e0-42a1-bc68-e4baf153c3b3 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 5d30ed54-909d-491f-a14c-bc4435cfdc6f] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:33:06.686163 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG dbcounter [-] [117988] Writing DB stats nova_api:SELECT=28 {{(pid=117988) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:33:06.688598 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-a4f84f13-a0e0-42a1-bc68-e4baf153c3b3 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:33:06.689262 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-a4f84f13-a0e0-42a1-bc68-e4baf153c3b3 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:33:06.690342 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-a4f84f13-a0e0-42a1-bc68-e4baf153c3b3 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:33:06.690780 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-a4f84f13-a0e0-42a1-bc68-e4baf153c3b3 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:33:06.954982 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-a4f84f13-a0e0-42a1-bc68-e4baf153c3b3 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:33:06.963874 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-a4f84f13-a0e0-42a1-bc68-e4baf153c3b3 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:33:06.965923 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-a4f84f13-a0e0-42a1-bc68-e4baf153c3b3 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:33:06.967094 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-a4f84f13-a0e0-42a1-bc68-e4baf153c3b3 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f" status: 200 len: 1796 microversion: 2.20 time: 0.312472 Jul 12 13:33:06.977041 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 266/524] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:33:06 2022] GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f => generated 1796 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:33:13.271296 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-609fb023-f003-4ad2-9123-872d4d6c0664 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Action: 'create', calling method: .version_select at 0x7f76e9166dc0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1091250699", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAZcDdeYCpCYspgxzCK8QmYGPO6KOjLRbTSOmFUGs+2vXkUxmt/tv+DGyCMhipntYgxZ54LNwpLfETijZMIEGMhdu1UK9Wse4nKbSSpEHNGqhurI0fLJcoA0SwsVVuMSpQ=="}} {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:33:13.285147 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG dbcounter [-] [117987] Writing DB stats nova_api:SELECT=24 {{(pid=117987) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:33:13.301667 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.quota [None req-609fb023-f003-4ad2-9123-872d4d6c0664 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Getting quotas for project b3897c86b8c847ea9091f3c7ad344fa1. Resources: {'key_pairs'} {{(pid=117987) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 13:33:13.307248 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.quota [None req-609fb023-f003-4ad2-9123-872d4d6c0664 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Getting quotas for user 8aa0b8a0b7ff4eb0b13fb985dc0d710a and project b3897c86b8c847ea9091f3c7ad344fa1. Resources: {'key_pairs'} {{(pid=117987) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 13:33:13.342828 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-609fb023-f003-4ad2-9123-872d4d6c0664 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.297577 Jul 12 13:33:13.344241 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 259/525] 10.222.0.23 () {60 vars in 1158 bytes} [Tue Jul 12 13:33:13 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:33:18.212705 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG dbcounter [-] [117988] Writing DB stats nova_api:SELECT=1 {{(pid=117988) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:33:18.213528 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG dbcounter [-] [117988] Writing DB stats nova_cell1:SELECT=67 {{(pid=117988) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:33:18.340178 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-a2e4d121-12cd-494b-8783-9d6be9a6a6cc tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:33:18.340686 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-a2e4d121-12cd-494b-8783-9d6be9a6a6cc tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] [instance: eeb0b554-cd09-49b5-95f0-22fc7c707944] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:33:18.347341 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-a2e4d121-12cd-494b-8783-9d6be9a6a6cc tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:33:18.347782 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-a2e4d121-12cd-494b-8783-9d6be9a6a6cc tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:33:18.348548 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-a2e4d121-12cd-494b-8783-9d6be9a6a6cc tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:33:18.348978 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-a2e4d121-12cd-494b-8783-9d6be9a6a6cc tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:33:18.437966 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.objects.instance [None req-a2e4d121-12cd-494b-8783-9d6be9a6a6cc tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lazy-loading 'services' on Instance uuid eeb0b554-cd09-49b5-95f0-22fc7c707944 {{(pid=117988) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 13:33:18.514401 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-a2e4d121-12cd-494b-8783-9d6be9a6a6cc tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] 10.222.0.23 "DELETE /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944/os-volume_attachments/8c804a5d-9b3c-4e21-80be-178bb88ab681" status: 202 len: 0 microversion: 2.1 time: 0.306313 Jul 12 13:33:18.515356 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 267/526] 10.222.0.23 () {58 vars in 1415 bytes} [Tue Jul 12 13:33:18 2022] DELETE /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944/os-volume_attachments/8c804a5d-9b3c-4e21-80be-178bb88ab681 => generated 0 bytes in 308 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 13:33:19.642622 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG dbcounter [-] [117987] Writing DB stats nova_cell1:SELECT=65 {{(pid=117987) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:33:19.647220 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-4b8d505e-2228-4940-ad3e-525fa6bf5e08 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:33:19.654778 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-4b8d505e-2228-4940-ad3e-525fa6bf5e08 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:33:19.655215 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-4b8d505e-2228-4940-ad3e-525fa6bf5e08 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:33:19.680063 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-4b8d505e-2228-4940-ad3e-525fa6bf5e08 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] [instance: eeb0b554-cd09-49b5-95f0-22fc7c707944] Going to try to stop instance {{(pid=117987) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 12 13:33:19.725455 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-4b8d505e-2228-4940-ad3e-525fa6bf5e08 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] 10.222.0.23 "POST /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944/action" status: 202 len: 0 microversion: 2.1 time: 0.083786 Jul 12 13:33:19.726023 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 260/527] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 12 13:33:19 2022] POST /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 13:33:19.736637 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-9a4ee878-83c8-4cf4-8a76-57899fa3ff58 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:33:19.737658 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-9a4ee878-83c8-4cf4-8a76-57899fa3ff58 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] [instance: eeb0b554-cd09-49b5-95f0-22fc7c707944] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:33:19.744534 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-9a4ee878-83c8-4cf4-8a76-57899fa3ff58 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:33:19.744979 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-9a4ee878-83c8-4cf4-8a76-57899fa3ff58 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:33:19.746642 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-9a4ee878-83c8-4cf4-8a76-57899fa3ff58 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:33:19.747242 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-9a4ee878-83c8-4cf4-8a76-57899fa3ff58 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:33:19.892401 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-9a4ee878-83c8-4cf4-8a76-57899fa3ff58 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b710bbdf0c4d58b4f3ee7ef7410c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8fca4ab6ed466a864c5551fea5f7ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:33:19.900535 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-9a4ee878-83c8-4cf4-8a76-57899fa3ff58 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] 10.222.0.23 "GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944" status: 200 len: 1679 microversion: 2.1 time: 0.168478 Jul 12 13:33:19.901295 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 268/528] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:33:19 2022] GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944 => generated 1679 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:33:20.921061 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-790fbb4c-c7cb-4f79-b2d4-d5f1f95083c0 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:33:20.921765 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-790fbb4c-c7cb-4f79-b2d4-d5f1f95083c0 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] [instance: eeb0b554-cd09-49b5-95f0-22fc7c707944] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:33:20.928208 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-790fbb4c-c7cb-4f79-b2d4-d5f1f95083c0 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:33:20.928655 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-790fbb4c-c7cb-4f79-b2d4-d5f1f95083c0 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:33:20.929458 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-790fbb4c-c7cb-4f79-b2d4-d5f1f95083c0 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:33:20.929888 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-790fbb4c-c7cb-4f79-b2d4-d5f1f95083c0 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:33:21.071448 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-790fbb4c-c7cb-4f79-b2d4-d5f1f95083c0 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b710bbdf0c4d58b4f3ee7ef7410c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8fca4ab6ed466a864c5551fea5f7ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:33:21.079141 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-790fbb4c-c7cb-4f79-b2d4-d5f1f95083c0 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] 10.222.0.23 "GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944" status: 200 len: 1679 microversion: 2.1 time: 0.162673 Jul 12 13:33:21.079711 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 261/529] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:33:20 2022] GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944 => generated 1679 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:33:22.097476 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-01ad5dfa-afa0-42d5-af23-9a0b3a5e199d tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:33:22.098076 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-01ad5dfa-afa0-42d5-af23-9a0b3a5e199d tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] [instance: eeb0b554-cd09-49b5-95f0-22fc7c707944] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:33:22.104629 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-01ad5dfa-afa0-42d5-af23-9a0b3a5e199d tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:33:22.105830 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-01ad5dfa-afa0-42d5-af23-9a0b3a5e199d tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:33:22.106551 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-01ad5dfa-afa0-42d5-af23-9a0b3a5e199d tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:33:22.106978 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-01ad5dfa-afa0-42d5-af23-9a0b3a5e199d tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:33:22.251954 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-01ad5dfa-afa0-42d5-af23-9a0b3a5e199d tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b710bbdf0c4d58b4f3ee7ef7410c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8fca4ab6ed466a864c5551fea5f7ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:33:22.263456 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-01ad5dfa-afa0-42d5-af23-9a0b3a5e199d tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] 10.222.0.23 "GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944" status: 200 len: 1679 microversion: 2.1 time: 0.169871 Jul 12 13:33:22.264047 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 269/530] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:33:22 2022] GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944 => generated 1679 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:33:23.280975 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-fbe6717e-fbff-48ca-906e-e12191e67c58 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:33:23.281611 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-fbe6717e-fbff-48ca-906e-e12191e67c58 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] [instance: eeb0b554-cd09-49b5-95f0-22fc7c707944] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:33:23.288243 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-fbe6717e-fbff-48ca-906e-e12191e67c58 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:33:23.288685 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-fbe6717e-fbff-48ca-906e-e12191e67c58 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:33:23.289469 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-fbe6717e-fbff-48ca-906e-e12191e67c58 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:33:23.289895 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-fbe6717e-fbff-48ca-906e-e12191e67c58 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:33:23.323745 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG dbcounter [-] [117987] Writing DB stats nova_cell0:SELECT=4 {{(pid=117987) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:33:23.441151 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-fbe6717e-fbff-48ca-906e-e12191e67c58 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b710bbdf0c4d58b4f3ee7ef7410c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8fca4ab6ed466a864c5551fea5f7ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:33:23.450202 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-fbe6717e-fbff-48ca-906e-e12191e67c58 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] 10.222.0.23 "GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944" status: 200 len: 1679 microversion: 2.1 time: 0.173337 Jul 12 13:33:23.450831 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 262/531] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:33:23 2022] GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944 => generated 1679 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:33:24.470178 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-1c91c497-0bcf-4164-9bac-6ee3441c65bf tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:33:24.470794 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-1c91c497-0bcf-4164-9bac-6ee3441c65bf tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] [instance: eeb0b554-cd09-49b5-95f0-22fc7c707944] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:33:24.477521 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-1c91c497-0bcf-4164-9bac-6ee3441c65bf tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:33:24.477990 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-1c91c497-0bcf-4164-9bac-6ee3441c65bf tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:33:24.478742 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-1c91c497-0bcf-4164-9bac-6ee3441c65bf tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:33:24.479180 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-1c91c497-0bcf-4164-9bac-6ee3441c65bf tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:33:24.618270 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-1c91c497-0bcf-4164-9bac-6ee3441c65bf tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b710bbdf0c4d58b4f3ee7ef7410c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8fca4ab6ed466a864c5551fea5f7ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:33:24.626913 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-1c91c497-0bcf-4164-9bac-6ee3441c65bf tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] 10.222.0.23 "GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944" status: 200 len: 1679 microversion: 2.1 time: 0.161052 Jul 12 13:33:24.627526 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 270/532] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:33:24 2022] GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944 => generated 1679 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:33:24.836671 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-8b3693d0-aa15-4951-8728-2a9b193579e3 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d5f4335b-7712-4da4-ab0f-002f9fff8c1e"}} {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:33:24.837900 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-8b3693d0-aa15-4951-8728-2a9b193579e3 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: 5982cf25-982e-4787-8992-63184a0dd50f] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:33:24.845677 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-8b3693d0-aa15-4951-8728-2a9b193579e3 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:33:24.846121 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-8b3693d0-aa15-4951-8728-2a9b193579e3 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:33:24.846898 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-8b3693d0-aa15-4951-8728-2a9b193579e3 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:33:24.847330 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-8b3693d0-aa15-4951-8728-2a9b193579e3 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:33:25.188691 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-8b3693d0-aa15-4951-8728-2a9b193579e3 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "POST /compute/v2.1/servers/5982cf25-982e-4787-8992-63184a0dd50f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.464986 Jul 12 13:33:25.189516 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 263/533] 10.222.0.23 () {60 vars in 1322 bytes} [Tue Jul 12 13:33:24 2022] POST /compute/v2.1/servers/5982cf25-982e-4787-8992-63184a0dd50f/os-volume_attachments => generated 194 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:33:25.644151 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-5710a645-15af-4488-97bc-4c8a181067ef tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:33:25.644676 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-5710a645-15af-4488-97bc-4c8a181067ef tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] [instance: eeb0b554-cd09-49b5-95f0-22fc7c707944] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:33:25.652997 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-5710a645-15af-4488-97bc-4c8a181067ef tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:33:25.652997 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-5710a645-15af-4488-97bc-4c8a181067ef tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:33:25.653711 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-5710a645-15af-4488-97bc-4c8a181067ef tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:33:25.654130 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-5710a645-15af-4488-97bc-4c8a181067ef tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:33:25.792580 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-5710a645-15af-4488-97bc-4c8a181067ef tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b710bbdf0c4d58b4f3ee7ef7410c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8fca4ab6ed466a864c5551fea5f7ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:33:25.800811 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-5710a645-15af-4488-97bc-4c8a181067ef tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] 10.222.0.23 "GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944" status: 200 len: 1679 microversion: 2.1 time: 0.160567 Jul 12 13:33:25.801409 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 271/534] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:33:25 2022] GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944 => generated 1679 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:33:26.820262 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-be591260-3aa2-4f8c-8752-4637eb4b94c5 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:33:26.820961 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-be591260-3aa2-4f8c-8752-4637eb4b94c5 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] [instance: eeb0b554-cd09-49b5-95f0-22fc7c707944] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:33:26.828360 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-be591260-3aa2-4f8c-8752-4637eb4b94c5 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:33:26.828806 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-be591260-3aa2-4f8c-8752-4637eb4b94c5 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:33:26.829605 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-be591260-3aa2-4f8c-8752-4637eb4b94c5 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:33:26.830056 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-be591260-3aa2-4f8c-8752-4637eb4b94c5 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:33:26.962129 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-be591260-3aa2-4f8c-8752-4637eb4b94c5 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b710bbdf0c4d58b4f3ee7ef7410c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8fca4ab6ed466a864c5551fea5f7ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:33:26.970274 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-be591260-3aa2-4f8c-8752-4637eb4b94c5 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] 10.222.0.23 "GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944" status: 200 len: 1679 microversion: 2.1 time: 0.154938 Jul 12 13:33:26.970839 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 264/535] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:33:26 2022] GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944 => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:33:27.989400 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-82a5bfea-2ae4-4d54-9b10-7d6a3d693e7e tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:33:27.990013 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-82a5bfea-2ae4-4d54-9b10-7d6a3d693e7e tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] [instance: eeb0b554-cd09-49b5-95f0-22fc7c707944] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:33:27.997488 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-82a5bfea-2ae4-4d54-9b10-7d6a3d693e7e tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:33:27.997919 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-82a5bfea-2ae4-4d54-9b10-7d6a3d693e7e tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:33:27.998696 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-82a5bfea-2ae4-4d54-9b10-7d6a3d693e7e tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:33:27.999126 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-82a5bfea-2ae4-4d54-9b10-7d6a3d693e7e tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:33:28.141545 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-82a5bfea-2ae4-4d54-9b10-7d6a3d693e7e tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b710bbdf0c4d58b4f3ee7ef7410c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8fca4ab6ed466a864c5551fea5f7ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:33:28.149120 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-82a5bfea-2ae4-4d54-9b10-7d6a3d693e7e tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] 10.222.0.23 "GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944" status: 200 len: 1679 microversion: 2.1 time: 0.163599 Jul 12 13:33:28.149716 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 272/536] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:33:27 2022] GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944 => generated 1679 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:33:29.166388 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-1728cebf-fd73-475c-92e0-ee017eb59b08 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:33:29.166997 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-1728cebf-fd73-475c-92e0-ee017eb59b08 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] [instance: eeb0b554-cd09-49b5-95f0-22fc7c707944] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:33:29.174217 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-1728cebf-fd73-475c-92e0-ee017eb59b08 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:33:29.174665 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-1728cebf-fd73-475c-92e0-ee017eb59b08 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:33:29.175431 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-1728cebf-fd73-475c-92e0-ee017eb59b08 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:33:29.175860 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-1728cebf-fd73-475c-92e0-ee017eb59b08 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:33:29.314545 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-1728cebf-fd73-475c-92e0-ee017eb59b08 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b710bbdf0c4d58b4f3ee7ef7410c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8fca4ab6ed466a864c5551fea5f7ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:33:29.322492 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-1728cebf-fd73-475c-92e0-ee017eb59b08 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] 10.222.0.23 "GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944" status: 200 len: 1679 microversion: 2.1 time: 0.159981 Jul 12 13:33:29.323072 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 265/537] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:33:29 2022] GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944 => generated 1679 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:33:30.339460 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-2a4dedee-b2d2-4295-af87-1a5711f80d64 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:33:30.340063 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-2a4dedee-b2d2-4295-af87-1a5711f80d64 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] [instance: eeb0b554-cd09-49b5-95f0-22fc7c707944] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:33:30.347444 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-2a4dedee-b2d2-4295-af87-1a5711f80d64 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:33:30.347886 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-2a4dedee-b2d2-4295-af87-1a5711f80d64 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:33:30.348651 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-2a4dedee-b2d2-4295-af87-1a5711f80d64 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:33:30.349077 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-2a4dedee-b2d2-4295-af87-1a5711f80d64 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:33:30.489291 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-2a4dedee-b2d2-4295-af87-1a5711f80d64 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b710bbdf0c4d58b4f3ee7ef7410c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8fca4ab6ed466a864c5551fea5f7ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:33:30.500909 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-2a4dedee-b2d2-4295-af87-1a5711f80d64 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] 10.222.0.23 "GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944" status: 200 len: 1679 microversion: 2.1 time: 0.162396 Jul 12 13:33:30.500909 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 273/538] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:33:30 2022] GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944 => generated 1679 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:33:31.516436 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-6e824031-5a41-4db0-baa3-20ceffb1c3b7 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:33:31.516974 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-6e824031-5a41-4db0-baa3-20ceffb1c3b7 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] [instance: eeb0b554-cd09-49b5-95f0-22fc7c707944] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:33:31.523734 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-6e824031-5a41-4db0-baa3-20ceffb1c3b7 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:33:31.524179 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-6e824031-5a41-4db0-baa3-20ceffb1c3b7 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:33:31.524951 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-6e824031-5a41-4db0-baa3-20ceffb1c3b7 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:33:31.525403 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-6e824031-5a41-4db0-baa3-20ceffb1c3b7 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:33:31.664969 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-6e824031-5a41-4db0-baa3-20ceffb1c3b7 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b710bbdf0c4d58b4f3ee7ef7410c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8fca4ab6ed466a864c5551fea5f7ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:33:31.673348 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-6e824031-5a41-4db0-baa3-20ceffb1c3b7 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] 10.222.0.23 "GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944" status: 200 len: 1679 microversion: 2.1 time: 0.161640 Jul 12 13:33:31.673954 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 266/539] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:33:31 2022] GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944 => generated 1679 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:33:32.690683 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-515363e1-18a3-47bd-8dc0-c6d922eb1e9f tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:33:32.691371 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-515363e1-18a3-47bd-8dc0-c6d922eb1e9f tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] [instance: eeb0b554-cd09-49b5-95f0-22fc7c707944] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:33:32.698009 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-515363e1-18a3-47bd-8dc0-c6d922eb1e9f tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:33:32.698458 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-515363e1-18a3-47bd-8dc0-c6d922eb1e9f tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:33:32.699230 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-515363e1-18a3-47bd-8dc0-c6d922eb1e9f tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:33:32.699665 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-515363e1-18a3-47bd-8dc0-c6d922eb1e9f tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:33:32.832734 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-515363e1-18a3-47bd-8dc0-c6d922eb1e9f tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b710bbdf0c4d58b4f3ee7ef7410c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8fca4ab6ed466a864c5551fea5f7ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:33:32.841423 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-515363e1-18a3-47bd-8dc0-c6d922eb1e9f tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] 10.222.0.23 "GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944" status: 200 len: 1679 microversion: 2.1 time: 0.154166 Jul 12 13:33:32.842491 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 274/540] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:33:32 2022] GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944 => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:33:33.766626 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-67d15f47-08e1-49be-85ae-7b8ed7a8ee2e tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:33:33.767629 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-67d15f47-08e1-49be-85ae-7b8ed7a8ee2e tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: 5982cf25-982e-4787-8992-63184a0dd50f] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:33:33.774363 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-67d15f47-08e1-49be-85ae-7b8ed7a8ee2e tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:33:33.774807 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-67d15f47-08e1-49be-85ae-7b8ed7a8ee2e tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:33:33.775576 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-67d15f47-08e1-49be-85ae-7b8ed7a8ee2e tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:33:33.776009 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-67d15f47-08e1-49be-85ae-7b8ed7a8ee2e tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:33:33.801025 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.objects.instance [None req-67d15f47-08e1-49be-85ae-7b8ed7a8ee2e tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lazy-loading 'flavor' on Instance uuid 5982cf25-982e-4787-8992-63184a0dd50f {{(pid=117987) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 13:33:33.859296 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-30cd787a-82fc-4aa3-a299-593c7d591bb1 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:33:33.860011 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-30cd787a-82fc-4aa3-a299-593c7d591bb1 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] [instance: eeb0b554-cd09-49b5-95f0-22fc7c707944] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:33:33.866845 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-30cd787a-82fc-4aa3-a299-593c7d591bb1 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:33:33.867287 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-30cd787a-82fc-4aa3-a299-593c7d591bb1 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:33:33.868070 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-30cd787a-82fc-4aa3-a299-593c7d591bb1 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:33:33.868459 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-30cd787a-82fc-4aa3-a299-593c7d591bb1 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:33:33.938433 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-67d15f47-08e1-49be-85ae-7b8ed7a8ee2e tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "POST /compute/v2.1/servers/5982cf25-982e-4787-8992-63184a0dd50f/action" status: 200 len: 32 microversion: 2.1 time: 0.177107 Jul 12 13:33:33.939226 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 267/541] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 12 13:33:33 2022] POST /compute/v2.1/servers/5982cf25-982e-4787-8992-63184a0dd50f/action => generated 32 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 12 13:33:33.952464 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-f344765f-be92-40ab-9aa7-1675a81af942 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:33:33.953237 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-f344765f-be92-40ab-9aa7-1675a81af942 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: 5982cf25-982e-4787-8992-63184a0dd50f] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:33:33.960152 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-f344765f-be92-40ab-9aa7-1675a81af942 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:33:33.960605 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-f344765f-be92-40ab-9aa7-1675a81af942 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:33:33.961410 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-f344765f-be92-40ab-9aa7-1675a81af942 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:33:33.961849 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-f344765f-be92-40ab-9aa7-1675a81af942 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:33:34.076296 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-30cd787a-82fc-4aa3-a299-593c7d591bb1 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b710bbdf0c4d58b4f3ee7ef7410c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8fca4ab6ed466a864c5551fea5f7ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:33:34.085245 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-30cd787a-82fc-4aa3-a299-593c7d591bb1 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] 10.222.0.23 "GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944" status: 200 len: 1679 microversion: 2.1 time: 0.230251 Jul 12 13:33:34.085874 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 275/542] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:33:33 2022] GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944 => generated 1679 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:33:34.134240 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-f344765f-be92-40ab-9aa7-1675a81af942 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f448776d1074e22bfe6cfbe05e01db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27fe465e6743e19feec424e6e9f3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:33:34.143660 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-f344765f-be92-40ab-9aa7-1675a81af942 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "GET /compute/v2.1/servers/5982cf25-982e-4787-8992-63184a0dd50f" status: 200 len: 1737 microversion: 2.1 time: 0.196682 Jul 12 13:33:34.144333 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 268/543] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:33:33 2022] GET /compute/v2.1/servers/5982cf25-982e-4787-8992-63184a0dd50f => generated 1737 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:33:35.103751 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-6a013abe-7300-45ed-a9ee-7aecaa65e7c1 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:33:35.104332 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-6a013abe-7300-45ed-a9ee-7aecaa65e7c1 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] [instance: eeb0b554-cd09-49b5-95f0-22fc7c707944] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:33:35.111503 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-6a013abe-7300-45ed-a9ee-7aecaa65e7c1 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:33:35.111958 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-6a013abe-7300-45ed-a9ee-7aecaa65e7c1 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:33:35.112733 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-6a013abe-7300-45ed-a9ee-7aecaa65e7c1 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:33:35.113168 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-6a013abe-7300-45ed-a9ee-7aecaa65e7c1 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:33:35.161286 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-a1de712b-68c7-41d5-9747-6ac450b2ca39 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:33:35.162236 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-a1de712b-68c7-41d5-9747-6ac450b2ca39 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: 5982cf25-982e-4787-8992-63184a0dd50f] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:33:35.169144 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-a1de712b-68c7-41d5-9747-6ac450b2ca39 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:33:35.170242 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-a1de712b-68c7-41d5-9747-6ac450b2ca39 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:33:35.171104 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-a1de712b-68c7-41d5-9747-6ac450b2ca39 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:33:35.171626 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-a1de712b-68c7-41d5-9747-6ac450b2ca39 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:33:35.303086 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-6a013abe-7300-45ed-a9ee-7aecaa65e7c1 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b710bbdf0c4d58b4f3ee7ef7410c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8fca4ab6ed466a864c5551fea5f7ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:33:35.311438 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-6a013abe-7300-45ed-a9ee-7aecaa65e7c1 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] 10.222.0.23 "GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944" status: 200 len: 1679 microversion: 2.1 time: 0.211679 Jul 12 13:33:35.312159 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 276/544] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:33:35 2022] GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944 => generated 1679 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:33:35.352539 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-a1de712b-68c7-41d5-9747-6ac450b2ca39 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f448776d1074e22bfe6cfbe05e01db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27fe465e6743e19feec424e6e9f3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:33:35.363182 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-a1de712b-68c7-41d5-9747-6ac450b2ca39 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "GET /compute/v2.1/servers/5982cf25-982e-4787-8992-63184a0dd50f" status: 200 len: 1737 microversion: 2.1 time: 0.205807 Jul 12 13:33:35.364010 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 269/545] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:33:35 2022] GET /compute/v2.1/servers/5982cf25-982e-4787-8992-63184a0dd50f => generated 1737 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:33:36.328820 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-b4ee1945-9819-405e-8f97-b87ea0a9a895 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:33:36.329368 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-b4ee1945-9819-405e-8f97-b87ea0a9a895 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] [instance: eeb0b554-cd09-49b5-95f0-22fc7c707944] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:33:36.336244 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-b4ee1945-9819-405e-8f97-b87ea0a9a895 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:33:36.336696 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-b4ee1945-9819-405e-8f97-b87ea0a9a895 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:33:36.337526 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-b4ee1945-9819-405e-8f97-b87ea0a9a895 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:33:36.337966 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-b4ee1945-9819-405e-8f97-b87ea0a9a895 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:33:36.383038 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-9dc25005-e417-4506-ac35-c776e8fe2def tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:33:36.383651 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-9dc25005-e417-4506-ac35-c776e8fe2def tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: 5982cf25-982e-4787-8992-63184a0dd50f] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:33:36.391230 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-9dc25005-e417-4506-ac35-c776e8fe2def tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:33:36.391699 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-9dc25005-e417-4506-ac35-c776e8fe2def tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:33:36.392475 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-9dc25005-e417-4506-ac35-c776e8fe2def tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:33:36.392904 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-9dc25005-e417-4506-ac35-c776e8fe2def tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:33:36.536451 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-b4ee1945-9819-405e-8f97-b87ea0a9a895 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b710bbdf0c4d58b4f3ee7ef7410c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8fca4ab6ed466a864c5551fea5f7ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:33:36.549415 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-b4ee1945-9819-405e-8f97-b87ea0a9a895 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] 10.222.0.23 "GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944" status: 200 len: 1656 microversion: 2.1 time: 0.224761 Jul 12 13:33:36.550023 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 277/546] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:33:36 2022] GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944 => generated 1656 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:33:36.566284 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-c35b031f-bed3-4b7a-bdac-8882a304a619 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:33:36.566776 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-9dc25005-e417-4506-ac35-c776e8fe2def tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f448776d1074e22bfe6cfbe05e01db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27fe465e6743e19feec424e6e9f3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:33:36.572843 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-c35b031f-bed3-4b7a-bdac-8882a304a619 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:33:36.573286 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-c35b031f-bed3-4b7a-bdac-8882a304a619 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:33:36.574932 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-9dc25005-e417-4506-ac35-c776e8fe2def tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "GET /compute/v2.1/servers/5982cf25-982e-4787-8992-63184a0dd50f" status: 200 len: 1737 microversion: 2.1 time: 0.195656 Jul 12 13:33:36.575676 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 270/547] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:33:36 2022] GET /compute/v2.1/servers/5982cf25-982e-4787-8992-63184a0dd50f => generated 1737 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:33:36.600838 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-c35b031f-bed3-4b7a-bdac-8882a304a619 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] [instance: eeb0b554-cd09-49b5-95f0-22fc7c707944] Going to try to start instance {{(pid=117988) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 12 13:33:36.644240 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-c35b031f-bed3-4b7a-bdac-8882a304a619 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] 10.222.0.23 "POST /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944/action" status: 202 len: 0 microversion: 2.1 time: 0.081898 Jul 12 13:33:36.644852 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 278/548] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 12 13:33:36 2022] POST /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 12 13:33:36.653259 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-fdbf5f78-13f3-4d61-92da-7a13a0c59362 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:33:36.655228 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-fdbf5f78-13f3-4d61-92da-7a13a0c59362 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] [instance: eeb0b554-cd09-49b5-95f0-22fc7c707944] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:33:36.663738 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-fdbf5f78-13f3-4d61-92da-7a13a0c59362 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:33:36.664195 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-fdbf5f78-13f3-4d61-92da-7a13a0c59362 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:33:36.664996 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-fdbf5f78-13f3-4d61-92da-7a13a0c59362 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:33:36.665482 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-fdbf5f78-13f3-4d61-92da-7a13a0c59362 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:33:36.829151 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-fdbf5f78-13f3-4d61-92da-7a13a0c59362 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b710bbdf0c4d58b4f3ee7ef7410c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8fca4ab6ed466a864c5551fea5f7ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:33:36.837957 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-fdbf5f78-13f3-4d61-92da-7a13a0c59362 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] 10.222.0.23 "GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944" status: 200 len: 1665 microversion: 2.1 time: 0.188371 Jul 12 13:33:36.838461 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 271/549] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:33:36 2022] GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944 => generated 1665 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:33:37.597295 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-d8058e61-9b7b-43ed-800b-b0198afcc766 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:33:37.598632 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-d8058e61-9b7b-43ed-800b-b0198afcc766 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: 5982cf25-982e-4787-8992-63184a0dd50f] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:33:37.608994 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-d8058e61-9b7b-43ed-800b-b0198afcc766 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:33:37.609579 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-d8058e61-9b7b-43ed-800b-b0198afcc766 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:33:37.610609 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-d8058e61-9b7b-43ed-800b-b0198afcc766 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:33:37.611086 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-d8058e61-9b7b-43ed-800b-b0198afcc766 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:33:37.760456 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-d8058e61-9b7b-43ed-800b-b0198afcc766 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f448776d1074e22bfe6cfbe05e01db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27fe465e6743e19feec424e6e9f3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:33:37.769245 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-d8058e61-9b7b-43ed-800b-b0198afcc766 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "GET /compute/v2.1/servers/5982cf25-982e-4787-8992-63184a0dd50f" status: 200 len: 1737 microversion: 2.1 time: 0.180110 Jul 12 13:33:37.769848 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 279/550] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:33:37 2022] GET /compute/v2.1/servers/5982cf25-982e-4787-8992-63184a0dd50f => generated 1737 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:33:37.856234 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-61a22ec1-89ee-40e1-ba31-de506f6de347 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:33:37.857418 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-61a22ec1-89ee-40e1-ba31-de506f6de347 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] [instance: eeb0b554-cd09-49b5-95f0-22fc7c707944] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:33:37.864224 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-61a22ec1-89ee-40e1-ba31-de506f6de347 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:33:37.864670 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-61a22ec1-89ee-40e1-ba31-de506f6de347 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:33:37.865467 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-61a22ec1-89ee-40e1-ba31-de506f6de347 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:33:37.865903 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-61a22ec1-89ee-40e1-ba31-de506f6de347 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:33:37.870138 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG dbcounter [-] [117987] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=117987) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:33:38.009234 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-61a22ec1-89ee-40e1-ba31-de506f6de347 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b710bbdf0c4d58b4f3ee7ef7410c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8fca4ab6ed466a864c5551fea5f7ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:33:38.017637 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-61a22ec1-89ee-40e1-ba31-de506f6de347 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] 10.222.0.23 "GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944" status: 200 len: 1665 microversion: 2.1 time: 0.165313 Jul 12 13:33:38.018261 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 272/551] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:33:37 2022] GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944 => generated 1665 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:33:38.302893 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-2b69a385-78d5-42d3-9576-9b1b964a7be0 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-517893999", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1091250699", "security_groups": [{"name": "tempest-secgroup-smoke-1984417285"}], "block_device_mapping_v2": [{"uuid": "6a165738-afeb-4c42-9df3-4e78b12430d9", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "3a48b4be-b078-4673-8811-937900491f7b"}]}} {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:33:38.418029 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.network.neutron [None req-2b69a385-78d5-42d3-9576-9b1b964a7be0 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] validate_networks() for [('3a48b4be-b078-4673-8811-937900491f7b', None, None, None, None, None)] {{(pid=117988) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 13:33:38.786818 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-56ad8c87-09dd-4126-bd58-f44f688e0864 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:33:38.787443 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-56ad8c87-09dd-4126-bd58-f44f688e0864 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: 5982cf25-982e-4787-8992-63184a0dd50f] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:33:38.793702 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-56ad8c87-09dd-4126-bd58-f44f688e0864 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:33:38.795013 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-56ad8c87-09dd-4126-bd58-f44f688e0864 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:33:38.795633 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-56ad8c87-09dd-4126-bd58-f44f688e0864 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:33:38.796065 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-56ad8c87-09dd-4126-bd58-f44f688e0864 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:33:39.007422 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.virt.hardware [None req-2b69a385-78d5-42d3-9576-9b1b964a7be0 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Flavor limits 0:0:0 {{(pid=117988) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 13:33:39.008136 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.virt.hardware [None req-2b69a385-78d5-42d3-9576-9b1b964a7be0 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Image limits 0:0:0 {{(pid=117988) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 13:33:39.008306 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.virt.hardware [None req-2b69a385-78d5-42d3-9576-9b1b964a7be0 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Flavor pref 0:0:0 {{(pid=117988) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 13:33:39.008868 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.virt.hardware [None req-2b69a385-78d5-42d3-9576-9b1b964a7be0 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Image pref 0:0:0 {{(pid=117988) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 13:33:39.009283 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.virt.hardware [None req-2b69a385-78d5-42d3-9576-9b1b964a7be0 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117988) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 13:33:39.016380 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-56ad8c87-09dd-4126-bd58-f44f688e0864 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f448776d1074e22bfe6cfbe05e01db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27fe465e6743e19feec424e6e9f3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:33:39.020033 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-2b69a385-78d5-42d3-9576-9b1b964a7be0 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:33:39.020482 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-2b69a385-78d5-42d3-9576-9b1b964a7be0 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:33:39.021283 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-2b69a385-78d5-42d3-9576-9b1b964a7be0 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:33:39.021744 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-2b69a385-78d5-42d3-9576-9b1b964a7be0 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:33:39.025271 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-56ad8c87-09dd-4126-bd58-f44f688e0864 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "GET /compute/v2.1/servers/5982cf25-982e-4787-8992-63184a0dd50f" status: 200 len: 1737 microversion: 2.1 time: 0.242267 Jul 12 13:33:39.026158 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 273/552] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:33:38 2022] GET /compute/v2.1/servers/5982cf25-982e-4787-8992-63184a0dd50f => generated 1737 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:33:39.036153 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-c8863401-dfb3-4ac3-802a-d7c8dae6eeab tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:33:39.036777 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-c8863401-dfb3-4ac3-802a-d7c8dae6eeab tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] [instance: eeb0b554-cd09-49b5-95f0-22fc7c707944] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:33:39.040329 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.quota [None req-2b69a385-78d5-42d3-9576-9b1b964a7be0 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Getting quotas for project b3897c86b8c847ea9091f3c7ad344fa1. Resources: {'ram', 'cores', 'instances'} {{(pid=117988) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 13:33:39.042907 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-c8863401-dfb3-4ac3-802a-d7c8dae6eeab tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:33:39.043362 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-c8863401-dfb3-4ac3-802a-d7c8dae6eeab tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:33:39.044171 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-c8863401-dfb3-4ac3-802a-d7c8dae6eeab tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:33:39.044939 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.quota [None req-2b69a385-78d5-42d3-9576-9b1b964a7be0 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Getting quotas for user 8aa0b8a0b7ff4eb0b13fb985dc0d710a and project b3897c86b8c847ea9091f3c7ad344fa1. Resources: {'ram', 'cores', 'instances'} {{(pid=117988) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 13:33:39.045246 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-c8863401-dfb3-4ac3-802a-d7c8dae6eeab tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:33:39.110818 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-2b69a385-78d5-42d3-9576-9b1b964a7be0 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Going to run 1 instances... {{(pid=117988) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 13:33:39.113356 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-2b69a385-78d5-42d3-9576-9b1b964a7be0 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] [instance: a950219a-3350-49e1-ac49-2da471d9b327] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6a165738-afeb-4c42-9df3-4e78b12430d9',volume_size=None,volume_type=None)] {{(pid=117988) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 13:33:39.185577 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-c8863401-dfb3-4ac3-802a-d7c8dae6eeab tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b710bbdf0c4d58b4f3ee7ef7410c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8fca4ab6ed466a864c5551fea5f7ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:33:39.193647 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-c8863401-dfb3-4ac3-802a-d7c8dae6eeab tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] 10.222.0.23 "GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944" status: 200 len: 1669 microversion: 2.1 time: 0.161264 Jul 12 13:33:39.194309 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 274/553] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:33:39 2022] GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944 => generated 1669 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:33:39.266822 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-2b69a385-78d5-42d3-9576-9b1b964a7be0 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.967686 Jul 12 13:33:39.267624 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 280/554] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 12 13:33:38 2022] POST /compute/v2.1/servers => generated 406 bytes in 969 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 13:33:39.277241 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-474ea180-0930-48c6-930c-1107e589d9a6 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:33:39.277885 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-474ea180-0930-48c6-930c-1107e589d9a6 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] [instance: a950219a-3350-49e1-ac49-2da471d9b327] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:33:39.335376 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-474ea180-0930-48c6-930c-1107e589d9a6 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa0b8a0b7ff4eb0b13fb985dc0d710a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3897c86b8c847ea9091f3c7ad344fa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:33:39.343160 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-474ea180-0930-48c6-930c-1107e589d9a6 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] 10.222.0.23 "GET /compute/v2.1/servers/a950219a-3350-49e1-ac49-2da471d9b327" status: 200 len: 1094 microversion: 2.1 time: 0.069725 Jul 12 13:33:39.343833 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 275/555] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:33:39 2022] GET /compute/v2.1/servers/a950219a-3350-49e1-ac49-2da471d9b327 => generated 1094 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:33:40.045252 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-f471389b-a6b4-4acf-a14d-219b0c6b2683 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:33:40.046061 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-f471389b-a6b4-4acf-a14d-219b0c6b2683 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: 5982cf25-982e-4787-8992-63184a0dd50f] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:33:40.052737 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-f471389b-a6b4-4acf-a14d-219b0c6b2683 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:33:40.053176 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-f471389b-a6b4-4acf-a14d-219b0c6b2683 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:33:40.054002 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-f471389b-a6b4-4acf-a14d-219b0c6b2683 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:33:40.054431 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-f471389b-a6b4-4acf-a14d-219b0c6b2683 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:33:40.190828 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-f471389b-a6b4-4acf-a14d-219b0c6b2683 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f448776d1074e22bfe6cfbe05e01db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27fe465e6743e19feec424e6e9f3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:33:40.198829 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-f471389b-a6b4-4acf-a14d-219b0c6b2683 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "GET /compute/v2.1/servers/5982cf25-982e-4787-8992-63184a0dd50f" status: 200 len: 1737 microversion: 2.1 time: 0.158784 Jul 12 13:33:40.199613 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 281/556] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:33:40 2022] GET /compute/v2.1/servers/5982cf25-982e-4787-8992-63184a0dd50f => generated 1737 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:33:40.360233 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-46383ce7-eff3-4c76-a87d-ba39886f50b9 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:33:40.360834 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-46383ce7-eff3-4c76-a87d-ba39886f50b9 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] [instance: a950219a-3350-49e1-ac49-2da471d9b327] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:33:40.416016 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-46383ce7-eff3-4c76-a87d-ba39886f50b9 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa0b8a0b7ff4eb0b13fb985dc0d710a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3897c86b8c847ea9091f3c7ad344fa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:33:40.424492 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-46383ce7-eff3-4c76-a87d-ba39886f50b9 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] 10.222.0.23 "GET /compute/v2.1/servers/a950219a-3350-49e1-ac49-2da471d9b327" status: 200 len: 1094 microversion: 2.1 time: 0.068215 Jul 12 13:33:40.426885 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 276/557] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:33:40 2022] GET /compute/v2.1/servers/a950219a-3350-49e1-ac49-2da471d9b327 => generated 1094 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:33:41.216064 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-7851b4db-c4cc-42af-a470-15e67e684106 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:33:41.216650 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-7851b4db-c4cc-42af-a470-15e67e684106 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: 5982cf25-982e-4787-8992-63184a0dd50f] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:33:41.224090 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-7851b4db-c4cc-42af-a470-15e67e684106 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:33:41.224531 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-7851b4db-c4cc-42af-a470-15e67e684106 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:33:41.225303 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-7851b4db-c4cc-42af-a470-15e67e684106 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:33:41.225757 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-7851b4db-c4cc-42af-a470-15e67e684106 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:33:41.246109 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG dbcounter [-] [117988] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117988) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:33:41.362446 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-7851b4db-c4cc-42af-a470-15e67e684106 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f448776d1074e22bfe6cfbe05e01db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27fe465e6743e19feec424e6e9f3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:33:41.370441 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-7851b4db-c4cc-42af-a470-15e67e684106 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "GET /compute/v2.1/servers/5982cf25-982e-4787-8992-63184a0dd50f" status: 200 len: 1737 microversion: 2.1 time: 0.158214 Jul 12 13:33:41.371009 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 282/558] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:33:41 2022] GET /compute/v2.1/servers/5982cf25-982e-4787-8992-63184a0dd50f => generated 1737 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:33:41.444006 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-08429ad0-d622-4345-bbb6-0e7d484be658 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:33:41.444617 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-08429ad0-d622-4345-bbb6-0e7d484be658 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] [instance: a950219a-3350-49e1-ac49-2da471d9b327] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:33:41.503395 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-08429ad0-d622-4345-bbb6-0e7d484be658 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa0b8a0b7ff4eb0b13fb985dc0d710a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3897c86b8c847ea9091f3c7ad344fa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:33:41.510331 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-08429ad0-d622-4345-bbb6-0e7d484be658 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] 10.222.0.23 "GET /compute/v2.1/servers/a950219a-3350-49e1-ac49-2da471d9b327" status: 200 len: 1094 microversion: 2.1 time: 0.070476 Jul 12 13:33:41.510910 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 277/559] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:33:41 2022] GET /compute/v2.1/servers/a950219a-3350-49e1-ac49-2da471d9b327 => generated 1094 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:33:42.388698 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-fa1468c3-0a97-4523-98b2-c096ec56c6bb tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:33:42.389757 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-fa1468c3-0a97-4523-98b2-c096ec56c6bb tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: 5982cf25-982e-4787-8992-63184a0dd50f] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:33:42.397610 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-fa1468c3-0a97-4523-98b2-c096ec56c6bb tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:33:42.398413 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-fa1468c3-0a97-4523-98b2-c096ec56c6bb tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:33:42.399774 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-fa1468c3-0a97-4523-98b2-c096ec56c6bb tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:33:42.400582 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-fa1468c3-0a97-4523-98b2-c096ec56c6bb tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:33:42.527440 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-976ca760-ddf0-4106-bb76-240bec86528f tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:33:42.528064 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-976ca760-ddf0-4106-bb76-240bec86528f tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] [instance: a950219a-3350-49e1-ac49-2da471d9b327] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:33:42.540154 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-fa1468c3-0a97-4523-98b2-c096ec56c6bb tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f448776d1074e22bfe6cfbe05e01db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27fe465e6743e19feec424e6e9f3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:33:42.548552 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-fa1468c3-0a97-4523-98b2-c096ec56c6bb tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "GET /compute/v2.1/servers/5982cf25-982e-4787-8992-63184a0dd50f" status: 200 len: 1737 microversion: 2.1 time: 0.163925 Jul 12 13:33:42.549136 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 283/560] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:33:42 2022] GET /compute/v2.1/servers/5982cf25-982e-4787-8992-63184a0dd50f => generated 1737 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:33:42.582620 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-976ca760-ddf0-4106-bb76-240bec86528f tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa0b8a0b7ff4eb0b13fb985dc0d710a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3897c86b8c847ea9091f3c7ad344fa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:33:42.589488 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-976ca760-ddf0-4106-bb76-240bec86528f tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] 10.222.0.23 "GET /compute/v2.1/servers/a950219a-3350-49e1-ac49-2da471d9b327" status: 200 len: 1094 microversion: 2.1 time: 0.065814 Jul 12 13:33:42.590063 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 278/561] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:33:42 2022] GET /compute/v2.1/servers/a950219a-3350-49e1-ac49-2da471d9b327 => generated 1094 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:33:43.566479 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-d503ed80-f14a-461c-a9db-70fd5357ec8c tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:33:43.567086 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-d503ed80-f14a-461c-a9db-70fd5357ec8c tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: 5982cf25-982e-4787-8992-63184a0dd50f] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:33:43.573803 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-d503ed80-f14a-461c-a9db-70fd5357ec8c tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:33:43.574244 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-d503ed80-f14a-461c-a9db-70fd5357ec8c tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:33:43.575001 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-d503ed80-f14a-461c-a9db-70fd5357ec8c tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:33:43.575430 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-d503ed80-f14a-461c-a9db-70fd5357ec8c tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:33:43.606208 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-4b3f8987-a134-44c0-80ed-a9e20312da3e tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:33:43.606850 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-4b3f8987-a134-44c0-80ed-a9e20312da3e tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] [instance: a950219a-3350-49e1-ac49-2da471d9b327] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:33:43.609781 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG dbcounter [-] [117987] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=1 {{(pid=117987) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:33:43.615276 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-4b3f8987-a134-44c0-80ed-a9e20312da3e tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:33:43.615729 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-4b3f8987-a134-44c0-80ed-a9e20312da3e tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:33:43.616500 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-4b3f8987-a134-44c0-80ed-a9e20312da3e tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:33:43.616973 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-4b3f8987-a134-44c0-80ed-a9e20312da3e tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:33:43.693281 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-4b3f8987-a134-44c0-80ed-a9e20312da3e tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa0b8a0b7ff4eb0b13fb985dc0d710a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3897c86b8c847ea9091f3c7ad344fa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:33:43.701352 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-4b3f8987-a134-44c0-80ed-a9e20312da3e tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] 10.222.0.23 "GET /compute/v2.1/servers/a950219a-3350-49e1-ac49-2da471d9b327" status: 200 len: 1144 microversion: 2.1 time: 0.098811 Jul 12 13:33:43.701963 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 279/562] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:33:43 2022] GET /compute/v2.1/servers/a950219a-3350-49e1-ac49-2da471d9b327 => generated 1144 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:33:43.739545 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-d503ed80-f14a-461c-a9db-70fd5357ec8c tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f448776d1074e22bfe6cfbe05e01db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27fe465e6743e19feec424e6e9f3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:33:43.747979 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-d503ed80-f14a-461c-a9db-70fd5357ec8c tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "GET /compute/v2.1/servers/5982cf25-982e-4787-8992-63184a0dd50f" status: 200 len: 1737 microversion: 2.1 time: 0.185872 Jul 12 13:33:43.749144 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 284/563] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:33:43 2022] GET /compute/v2.1/servers/5982cf25-982e-4787-8992-63184a0dd50f => generated 1737 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:33:44.718311 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-1975c94a-16eb-40ae-9156-c7b37304ff0d tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:33:44.719031 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-1975c94a-16eb-40ae-9156-c7b37304ff0d tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] [instance: a950219a-3350-49e1-ac49-2da471d9b327] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:33:44.725780 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-1975c94a-16eb-40ae-9156-c7b37304ff0d tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:33:44.726303 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-1975c94a-16eb-40ae-9156-c7b37304ff0d tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:33:44.727092 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-1975c94a-16eb-40ae-9156-c7b37304ff0d tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:33:44.727522 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-1975c94a-16eb-40ae-9156-c7b37304ff0d tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:33:44.766913 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-367322ad-1314-4b9c-bf92-17d7f7ffc9af tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:33:44.767523 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-367322ad-1314-4b9c-bf92-17d7f7ffc9af tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: 5982cf25-982e-4787-8992-63184a0dd50f] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:33:44.773532 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-367322ad-1314-4b9c-bf92-17d7f7ffc9af tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:33:44.773929 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-367322ad-1314-4b9c-bf92-17d7f7ffc9af tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:33:44.774696 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-367322ad-1314-4b9c-bf92-17d7f7ffc9af tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:33:44.775129 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-367322ad-1314-4b9c-bf92-17d7f7ffc9af tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:33:44.798773 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-1975c94a-16eb-40ae-9156-c7b37304ff0d tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa0b8a0b7ff4eb0b13fb985dc0d710a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3897c86b8c847ea9091f3c7ad344fa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:33:44.806185 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-1975c94a-16eb-40ae-9156-c7b37304ff0d tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] 10.222.0.23 "GET /compute/v2.1/servers/a950219a-3350-49e1-ac49-2da471d9b327" status: 200 len: 1210 microversion: 2.1 time: 0.091913 Jul 12 13:33:44.806755 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 280/564] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:33:44 2022] GET /compute/v2.1/servers/a950219a-3350-49e1-ac49-2da471d9b327 => generated 1210 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:33:44.918684 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-367322ad-1314-4b9c-bf92-17d7f7ffc9af tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f448776d1074e22bfe6cfbe05e01db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27fe465e6743e19feec424e6e9f3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:33:44.926948 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-367322ad-1314-4b9c-bf92-17d7f7ffc9af tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "GET /compute/v2.1/servers/5982cf25-982e-4787-8992-63184a0dd50f" status: 200 len: 1737 microversion: 2.1 time: 0.164456 Jul 12 13:33:44.927516 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 285/565] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:33:44 2022] GET /compute/v2.1/servers/5982cf25-982e-4787-8992-63184a0dd50f => generated 1737 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:33:45.824759 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-0f30573f-cbd9-475a-a6ee-2240619e2dd2 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:33:45.825402 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-0f30573f-cbd9-475a-a6ee-2240619e2dd2 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] [instance: a950219a-3350-49e1-ac49-2da471d9b327] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:33:45.833184 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-0f30573f-cbd9-475a-a6ee-2240619e2dd2 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:33:45.833773 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-0f30573f-cbd9-475a-a6ee-2240619e2dd2 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:33:45.834560 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-0f30573f-cbd9-475a-a6ee-2240619e2dd2 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:33:45.834998 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-0f30573f-cbd9-475a-a6ee-2240619e2dd2 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:33:46.002327 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [req-58e7a01e-880d-4944-b4b8-bc6a89479cc1 req-432cf209-f840-4e22-a42b-bc878bbb79d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a950219a-3350-49e1-ac49-2da471d9b327", "tag": "f664b5fd-68ee-4047-bbea-3717c70b4099"}]} {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:33:46.003981 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-0f30573f-cbd9-475a-a6ee-2240619e2dd2 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa0b8a0b7ff4eb0b13fb985dc0d710a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3897c86b8c847ea9091f3c7ad344fa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:33:46.014236 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-0f30573f-cbd9-475a-a6ee-2240619e2dd2 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] 10.222.0.23 "GET /compute/v2.1/servers/a950219a-3350-49e1-ac49-2da471d9b327" status: 200 len: 1266 microversion: 2.1 time: 0.192603 Jul 12 13:33:46.016375 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 281/566] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:33:45 2022] GET /compute/v2.1/servers/a950219a-3350-49e1-ac49-2da471d9b327 => generated 1266 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:33:46.023641 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [req-58e7a01e-880d-4944-b4b8-bc6a89479cc1 req-432cf209-f840-4e22-a42b-bc878bbb79d7 service nova] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:33:46.023884 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-838b2406-92ed-4fac-b474-ca8f27a62b96 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:33:46.024304 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [req-58e7a01e-880d-4944-b4b8-bc6a89479cc1 req-432cf209-f840-4e22-a42b-bc878bbb79d7 service nova] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:33:46.024685 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-838b2406-92ed-4fac-b474-ca8f27a62b96 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: 5982cf25-982e-4787-8992-63184a0dd50f] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:33:46.036347 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-838b2406-92ed-4fac-b474-ca8f27a62b96 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:33:46.036804 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-838b2406-92ed-4fac-b474-ca8f27a62b96 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:33:46.038088 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.compute.server_external_events [req-58e7a01e-880d-4944-b4b8-bc6a89479cc1 req-432cf209-f840-4e22-a42b-bc878bbb79d7 service nova] Creating event network-changed:f664b5fd-68ee-4047-bbea-3717c70b4099 for instance a950219a-3350-49e1-ac49-2da471d9b327 on hv-cinder-82002 Jul 12 13:33:46.038228 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-838b2406-92ed-4fac-b474-ca8f27a62b96 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:33:46.038621 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-838b2406-92ed-4fac-b474-ca8f27a62b96 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:33:46.043986 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [req-58e7a01e-880d-4944-b4b8-bc6a89479cc1 req-432cf209-f840-4e22-a42b-bc878bbb79d7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122858 Jul 12 13:33:46.045303 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 286/567] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 12 13:33:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:33:46.193303 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-838b2406-92ed-4fac-b474-ca8f27a62b96 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f448776d1074e22bfe6cfbe05e01db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27fe465e6743e19feec424e6e9f3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:33:46.202142 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-838b2406-92ed-4fac-b474-ca8f27a62b96 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "GET /compute/v2.1/servers/5982cf25-982e-4787-8992-63184a0dd50f" status: 200 len: 1737 microversion: 2.1 time: 0.183459 Jul 12 13:33:46.202855 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 282/568] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:33:46 2022] GET /compute/v2.1/servers/5982cf25-982e-4787-8992-63184a0dd50f => generated 1737 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:33:47.034276 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-96ffb1b6-b916-47f0-a4c0-3b8e896c26a5 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:33:47.034963 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-96ffb1b6-b916-47f0-a4c0-3b8e896c26a5 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] [instance: a950219a-3350-49e1-ac49-2da471d9b327] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:33:47.041167 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-96ffb1b6-b916-47f0-a4c0-3b8e896c26a5 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:33:47.041646 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-96ffb1b6-b916-47f0-a4c0-3b8e896c26a5 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:33:47.042426 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-96ffb1b6-b916-47f0-a4c0-3b8e896c26a5 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:33:47.042853 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-96ffb1b6-b916-47f0-a4c0-3b8e896c26a5 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:33:47.180219 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-96ffb1b6-b916-47f0-a4c0-3b8e896c26a5 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa0b8a0b7ff4eb0b13fb985dc0d710a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3897c86b8c847ea9091f3c7ad344fa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:33:47.188060 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-96ffb1b6-b916-47f0-a4c0-3b8e896c26a5 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] 10.222.0.23 "GET /compute/v2.1/servers/a950219a-3350-49e1-ac49-2da471d9b327" status: 200 len: 1266 microversion: 2.1 time: 0.159050 Jul 12 13:33:47.188912 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 287/569] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:33:47 2022] GET /compute/v2.1/servers/a950219a-3350-49e1-ac49-2da471d9b327 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:33:47.219824 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-03f88086-ef4f-4b4d-b84b-c386e0d29e7a tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:33:47.220430 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-03f88086-ef4f-4b4d-b84b-c386e0d29e7a tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: 5982cf25-982e-4787-8992-63184a0dd50f] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:33:47.227027 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-03f88086-ef4f-4b4d-b84b-c386e0d29e7a tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:33:47.227478 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-03f88086-ef4f-4b4d-b84b-c386e0d29e7a tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:33:47.228274 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-03f88086-ef4f-4b4d-b84b-c386e0d29e7a tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:33:47.228708 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-03f88086-ef4f-4b4d-b84b-c386e0d29e7a tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:33:47.364483 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-03f88086-ef4f-4b4d-b84b-c386e0d29e7a tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f448776d1074e22bfe6cfbe05e01db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27fe465e6743e19feec424e6e9f3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:33:47.372628 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-03f88086-ef4f-4b4d-b84b-c386e0d29e7a tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "GET /compute/v2.1/servers/5982cf25-982e-4787-8992-63184a0dd50f" status: 200 len: 1737 microversion: 2.1 time: 0.157422 Jul 12 13:33:47.373211 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 283/570] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:33:47 2022] GET /compute/v2.1/servers/5982cf25-982e-4787-8992-63184a0dd50f => generated 1737 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:33:48.205319 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-78e11b41-0c65-4b2e-a6c8-bfcf7686d49b tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:33:48.205943 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-78e11b41-0c65-4b2e-a6c8-bfcf7686d49b tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] [instance: a950219a-3350-49e1-ac49-2da471d9b327] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:33:48.212333 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-78e11b41-0c65-4b2e-a6c8-bfcf7686d49b tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:33:48.212774 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-78e11b41-0c65-4b2e-a6c8-bfcf7686d49b tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:33:48.213548 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-78e11b41-0c65-4b2e-a6c8-bfcf7686d49b tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:33:48.213981 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-78e11b41-0c65-4b2e-a6c8-bfcf7686d49b tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:33:48.354556 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-78e11b41-0c65-4b2e-a6c8-bfcf7686d49b tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa0b8a0b7ff4eb0b13fb985dc0d710a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3897c86b8c847ea9091f3c7ad344fa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:33:48.364258 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-78e11b41-0c65-4b2e-a6c8-bfcf7686d49b tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] 10.222.0.23 "GET /compute/v2.1/servers/a950219a-3350-49e1-ac49-2da471d9b327" status: 200 len: 1266 microversion: 2.1 time: 0.162991 Jul 12 13:33:48.364835 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 288/571] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:33:48 2022] GET /compute/v2.1/servers/a950219a-3350-49e1-ac49-2da471d9b327 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:33:48.391242 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-7a430f9c-e88c-4d5b-9978-2e31403f86bd tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:33:48.392136 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-7a430f9c-e88c-4d5b-9978-2e31403f86bd tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: 5982cf25-982e-4787-8992-63184a0dd50f] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:33:48.398500 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-7a430f9c-e88c-4d5b-9978-2e31403f86bd tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:33:48.398949 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-7a430f9c-e88c-4d5b-9978-2e31403f86bd tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:33:48.399719 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-7a430f9c-e88c-4d5b-9978-2e31403f86bd tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:33:48.400155 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-7a430f9c-e88c-4d5b-9978-2e31403f86bd tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:33:48.557664 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-7a430f9c-e88c-4d5b-9978-2e31403f86bd tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f448776d1074e22bfe6cfbe05e01db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27fe465e6743e19feec424e6e9f3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:33:48.567157 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-7a430f9c-e88c-4d5b-9978-2e31403f86bd tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "GET /compute/v2.1/servers/5982cf25-982e-4787-8992-63184a0dd50f" status: 200 len: 1737 microversion: 2.1 time: 0.180719 Jul 12 13:33:48.567745 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 284/572] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:33:48 2022] GET /compute/v2.1/servers/5982cf25-982e-4787-8992-63184a0dd50f => generated 1737 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:33:49.380635 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-785a4a28-3fce-482c-a926-38fa4e7d1255 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:33:49.381369 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-785a4a28-3fce-482c-a926-38fa4e7d1255 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] [instance: a950219a-3350-49e1-ac49-2da471d9b327] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:33:49.383524 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG dbcounter [-] [117988] Writing DB stats nova_cell0:SELECT=2 {{(pid=117988) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:33:49.384229 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG dbcounter [-] [117988] Writing DB stats nova_cell0:SELECT=6 {{(pid=117988) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:33:49.385509 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG dbcounter [-] [117988] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=3 {{(pid=117988) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:33:49.392422 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-785a4a28-3fce-482c-a926-38fa4e7d1255 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:33:49.392871 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-785a4a28-3fce-482c-a926-38fa4e7d1255 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:33:49.393667 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-785a4a28-3fce-482c-a926-38fa4e7d1255 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:33:49.394111 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-785a4a28-3fce-482c-a926-38fa4e7d1255 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:33:49.535624 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-785a4a28-3fce-482c-a926-38fa4e7d1255 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa0b8a0b7ff4eb0b13fb985dc0d710a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3897c86b8c847ea9091f3c7ad344fa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:33:49.543174 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-785a4a28-3fce-482c-a926-38fa4e7d1255 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] 10.222.0.23 "GET /compute/v2.1/servers/a950219a-3350-49e1-ac49-2da471d9b327" status: 200 len: 1266 microversion: 2.1 time: 0.166511 Jul 12 13:33:49.543763 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 289/573] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:33:49 2022] GET /compute/v2.1/servers/a950219a-3350-49e1-ac49-2da471d9b327 => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:33:49.585706 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-6dca5182-07f9-4c5e-bd3a-70396675c9ca tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:33:49.586306 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-6dca5182-07f9-4c5e-bd3a-70396675c9ca tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: 5982cf25-982e-4787-8992-63184a0dd50f] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:33:49.596833 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-6dca5182-07f9-4c5e-bd3a-70396675c9ca tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:33:49.596833 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-6dca5182-07f9-4c5e-bd3a-70396675c9ca tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:33:49.596833 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-6dca5182-07f9-4c5e-bd3a-70396675c9ca tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:33:49.596833 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-6dca5182-07f9-4c5e-bd3a-70396675c9ca tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:33:49.738952 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-6dca5182-07f9-4c5e-bd3a-70396675c9ca tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f448776d1074e22bfe6cfbe05e01db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27fe465e6743e19feec424e6e9f3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:33:49.746950 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-6dca5182-07f9-4c5e-bd3a-70396675c9ca tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "GET /compute/v2.1/servers/5982cf25-982e-4787-8992-63184a0dd50f" status: 200 len: 1737 microversion: 2.1 time: 0.165145 Jul 12 13:33:49.747531 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 285/574] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:33:49 2022] GET /compute/v2.1/servers/5982cf25-982e-4787-8992-63184a0dd50f => generated 1737 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:33:50.559407 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-ad831cd0-ebed-4bce-bb75-a9068c158e6b tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:33:50.560037 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-ad831cd0-ebed-4bce-bb75-a9068c158e6b tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] [instance: a950219a-3350-49e1-ac49-2da471d9b327] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:33:50.567645 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-ad831cd0-ebed-4bce-bb75-a9068c158e6b tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:33:50.568097 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-ad831cd0-ebed-4bce-bb75-a9068c158e6b tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:33:50.568866 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-ad831cd0-ebed-4bce-bb75-a9068c158e6b tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:33:50.569305 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-ad831cd0-ebed-4bce-bb75-a9068c158e6b tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:33:50.705516 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-ad831cd0-ebed-4bce-bb75-a9068c158e6b tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa0b8a0b7ff4eb0b13fb985dc0d710a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3897c86b8c847ea9091f3c7ad344fa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:33:50.713106 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-ad831cd0-ebed-4bce-bb75-a9068c158e6b tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] 10.222.0.23 "GET /compute/v2.1/servers/a950219a-3350-49e1-ac49-2da471d9b327" status: 200 len: 1266 microversion: 2.1 time: 0.157552 Jul 12 13:33:50.713714 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 290/575] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:33:50 2022] GET /compute/v2.1/servers/a950219a-3350-49e1-ac49-2da471d9b327 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:33:50.764318 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-67721e34-fd2b-448e-824b-93af302923b8 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:33:50.764864 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-67721e34-fd2b-448e-824b-93af302923b8 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: 5982cf25-982e-4787-8992-63184a0dd50f] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:33:50.771301 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-67721e34-fd2b-448e-824b-93af302923b8 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:33:50.771739 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-67721e34-fd2b-448e-824b-93af302923b8 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:33:50.772495 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-67721e34-fd2b-448e-824b-93af302923b8 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:33:50.772922 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-67721e34-fd2b-448e-824b-93af302923b8 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:33:50.919424 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-67721e34-fd2b-448e-824b-93af302923b8 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f448776d1074e22bfe6cfbe05e01db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27fe465e6743e19feec424e6e9f3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:33:50.928773 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-67721e34-fd2b-448e-824b-93af302923b8 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "GET /compute/v2.1/servers/5982cf25-982e-4787-8992-63184a0dd50f" status: 200 len: 1737 microversion: 2.1 time: 0.168454 Jul 12 13:33:50.929688 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 286/576] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:33:50 2022] GET /compute/v2.1/servers/5982cf25-982e-4787-8992-63184a0dd50f => generated 1737 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:33:51.730670 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-fdde6d2a-21cc-424d-b8f2-839db5476e20 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:33:51.731277 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-fdde6d2a-21cc-424d-b8f2-839db5476e20 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] [instance: a950219a-3350-49e1-ac49-2da471d9b327] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:33:51.738992 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-fdde6d2a-21cc-424d-b8f2-839db5476e20 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:33:51.739451 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-fdde6d2a-21cc-424d-b8f2-839db5476e20 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:33:51.740226 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-fdde6d2a-21cc-424d-b8f2-839db5476e20 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:33:51.740662 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-fdde6d2a-21cc-424d-b8f2-839db5476e20 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:33:51.884131 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-fdde6d2a-21cc-424d-b8f2-839db5476e20 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa0b8a0b7ff4eb0b13fb985dc0d710a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3897c86b8c847ea9091f3c7ad344fa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:33:51.894084 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-fdde6d2a-21cc-424d-b8f2-839db5476e20 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] 10.222.0.23 "GET /compute/v2.1/servers/a950219a-3350-49e1-ac49-2da471d9b327" status: 200 len: 1266 microversion: 2.1 time: 0.167188 Jul 12 13:33:51.895142 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 291/577] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:33:51 2022] GET /compute/v2.1/servers/a950219a-3350-49e1-ac49-2da471d9b327 => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:33:51.947521 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-951232ac-8499-418c-a429-93bf6e5af9fd tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:33:51.948236 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-951232ac-8499-418c-a429-93bf6e5af9fd tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: 5982cf25-982e-4787-8992-63184a0dd50f] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:33:51.955870 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-951232ac-8499-418c-a429-93bf6e5af9fd tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:33:51.956420 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-951232ac-8499-418c-a429-93bf6e5af9fd tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:33:51.957338 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-951232ac-8499-418c-a429-93bf6e5af9fd tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:33:51.957873 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-951232ac-8499-418c-a429-93bf6e5af9fd tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:33:52.097447 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-951232ac-8499-418c-a429-93bf6e5af9fd tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f448776d1074e22bfe6cfbe05e01db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27fe465e6743e19feec424e6e9f3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:33:52.105491 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-951232ac-8499-418c-a429-93bf6e5af9fd tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "GET /compute/v2.1/servers/5982cf25-982e-4787-8992-63184a0dd50f" status: 200 len: 1737 microversion: 2.1 time: 0.161807 Jul 12 13:33:52.106077 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 287/578] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:33:51 2022] GET /compute/v2.1/servers/5982cf25-982e-4787-8992-63184a0dd50f => generated 1737 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:33:52.910895 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-ea5e4a73-57e8-4297-84cb-c65ff378bfae tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:33:52.911502 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-ea5e4a73-57e8-4297-84cb-c65ff378bfae tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] [instance: a950219a-3350-49e1-ac49-2da471d9b327] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:33:52.917930 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-ea5e4a73-57e8-4297-84cb-c65ff378bfae tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:33:52.918368 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-ea5e4a73-57e8-4297-84cb-c65ff378bfae tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:33:52.919127 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-ea5e4a73-57e8-4297-84cb-c65ff378bfae tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:33:52.919555 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-ea5e4a73-57e8-4297-84cb-c65ff378bfae tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:33:53.053119 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-ea5e4a73-57e8-4297-84cb-c65ff378bfae tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa0b8a0b7ff4eb0b13fb985dc0d710a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3897c86b8c847ea9091f3c7ad344fa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:33:53.062145 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-ea5e4a73-57e8-4297-84cb-c65ff378bfae tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] 10.222.0.23 "GET /compute/v2.1/servers/a950219a-3350-49e1-ac49-2da471d9b327" status: 200 len: 1266 microversion: 2.1 time: 0.153616 Jul 12 13:33:53.062748 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 292/579] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:33:52 2022] GET /compute/v2.1/servers/a950219a-3350-49e1-ac49-2da471d9b327 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:33:53.120690 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG dbcounter [-] [117987] Writing DB stats nova_cell0:SELECT=8 {{(pid=117987) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:33:53.126393 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-b96ee786-5827-4c64-99f7-3f142d69cefa tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:33:53.126992 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-b96ee786-5827-4c64-99f7-3f142d69cefa tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: 5982cf25-982e-4787-8992-63184a0dd50f] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:33:53.133597 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-b96ee786-5827-4c64-99f7-3f142d69cefa tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:33:53.134049 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-b96ee786-5827-4c64-99f7-3f142d69cefa tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:33:53.134805 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-b96ee786-5827-4c64-99f7-3f142d69cefa tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:33:53.135233 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-b96ee786-5827-4c64-99f7-3f142d69cefa tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:33:53.242608 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [req-1a92343f-66d3-47be-a53b-fb7a1c931d0e req-2cf7bb5e-1ffc-471f-88a9-bf0a321dcc06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a950219a-3350-49e1-ac49-2da471d9b327", "name": "network-vif-plugged", "status": "completed", "tag": "f664b5fd-68ee-4047-bbea-3717c70b4099"}]} {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:33:53.253131 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [req-1a92343f-66d3-47be-a53b-fb7a1c931d0e req-2cf7bb5e-1ffc-471f-88a9-bf0a321dcc06 service nova] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:33:53.253623 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [req-1a92343f-66d3-47be-a53b-fb7a1c931d0e req-2cf7bb5e-1ffc-471f-88a9-bf0a321dcc06 service nova] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:33:53.264918 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.compute.server_external_events [req-1a92343f-66d3-47be-a53b-fb7a1c931d0e req-2cf7bb5e-1ffc-471f-88a9-bf0a321dcc06 service nova] Creating event network-vif-plugged:f664b5fd-68ee-4047-bbea-3717c70b4099 for instance a950219a-3350-49e1-ac49-2da471d9b327 on hv-cinder-82002 Jul 12 13:33:53.270004 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [req-1a92343f-66d3-47be-a53b-fb7a1c931d0e req-2cf7bb5e-1ffc-471f-88a9-bf0a321dcc06 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098798 Jul 12 13:33:53.270598 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 293/580] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 12 13:33:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 13:33:53.276277 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-b96ee786-5827-4c64-99f7-3f142d69cefa tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f448776d1074e22bfe6cfbe05e01db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27fe465e6743e19feec424e6e9f3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:33:53.284480 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-b96ee786-5827-4c64-99f7-3f142d69cefa tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "GET /compute/v2.1/servers/5982cf25-982e-4787-8992-63184a0dd50f" status: 200 len: 1737 microversion: 2.1 time: 0.164632 Jul 12 13:33:53.285040 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 288/581] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:33:53 2022] GET /compute/v2.1/servers/5982cf25-982e-4787-8992-63184a0dd50f => generated 1737 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:33:54.081898 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-b10029c4-bafd-452c-82bc-282317508b79 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:33:54.082632 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-b10029c4-bafd-452c-82bc-282317508b79 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] [instance: a950219a-3350-49e1-ac49-2da471d9b327] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:33:54.090428 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-b10029c4-bafd-452c-82bc-282317508b79 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:33:54.090876 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-b10029c4-bafd-452c-82bc-282317508b79 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:33:54.091853 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-b10029c4-bafd-452c-82bc-282317508b79 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:33:54.092296 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-b10029c4-bafd-452c-82bc-282317508b79 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:33:54.238162 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-b10029c4-bafd-452c-82bc-282317508b79 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa0b8a0b7ff4eb0b13fb985dc0d710a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3897c86b8c847ea9091f3c7ad344fa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:33:54.246388 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-b10029c4-bafd-452c-82bc-282317508b79 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] 10.222.0.23 "GET /compute/v2.1/servers/a950219a-3350-49e1-ac49-2da471d9b327" status: 200 len: 1266 microversion: 2.1 time: 0.169372 Jul 12 13:33:54.247167 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 294/582] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:33:54 2022] GET /compute/v2.1/servers/a950219a-3350-49e1-ac49-2da471d9b327 => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:33:54.302196 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-2ac4e3ea-f044-4d53-b8c9-7044ba2e4014 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:33:54.302823 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-2ac4e3ea-f044-4d53-b8c9-7044ba2e4014 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: 5982cf25-982e-4787-8992-63184a0dd50f] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:33:54.309244 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-2ac4e3ea-f044-4d53-b8c9-7044ba2e4014 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:33:54.309723 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-2ac4e3ea-f044-4d53-b8c9-7044ba2e4014 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:33:54.311082 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-2ac4e3ea-f044-4d53-b8c9-7044ba2e4014 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:33:54.311515 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-2ac4e3ea-f044-4d53-b8c9-7044ba2e4014 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:33:54.444526 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-2ac4e3ea-f044-4d53-b8c9-7044ba2e4014 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f448776d1074e22bfe6cfbe05e01db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27fe465e6743e19feec424e6e9f3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:33:54.450857 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-2ac4e3ea-f044-4d53-b8c9-7044ba2e4014 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "GET /compute/v2.1/servers/5982cf25-982e-4787-8992-63184a0dd50f" status: 200 len: 1717 microversion: 2.1 time: 0.152518 Jul 12 13:33:54.452430 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 289/583] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:33:54 2022] GET /compute/v2.1/servers/5982cf25-982e-4787-8992-63184a0dd50f => generated 1717 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:33:54.507508 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-43bf4ea9-84fc-41ce-bd86-325c7597f965 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:33:54.508008 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-43bf4ea9-84fc-41ce-bd86-325c7597f965 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: 5982cf25-982e-4787-8992-63184a0dd50f] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:33:54.514928 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-43bf4ea9-84fc-41ce-bd86-325c7597f965 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:33:54.515381 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-43bf4ea9-84fc-41ce-bd86-325c7597f965 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:33:54.516155 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-43bf4ea9-84fc-41ce-bd86-325c7597f965 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:33:54.516592 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-43bf4ea9-84fc-41ce-bd86-325c7597f965 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:33:54.607848 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.wsgi [None req-43bf4ea9-84fc-41ce-bd86-325c7597f965 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] HTTP exception thrown: Cannot 'detach_volume' instance 5982cf25-982e-4787-8992-63184a0dd50f while it is in vm_state rescued Jul 12 13:33:54.609497 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-43bf4ea9-84fc-41ce-bd86-325c7597f965 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Request method failure captured: Jul 12 13:33:54.609497 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: request: DELETE /compute/v2.1/servers/5982cf25-982e-4787-8992-63184a0dd50f/os-volume_attachments/d5f4335b-7712-4da4-ab0f-002f9fff8c1e HTTP/1.1 Jul 12 13:33:54.609497 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: Accept: application/json Jul 12 13:33:54.609497 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: Accept-Encoding: identity Jul 12 13:33:54.609497 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: Connection: close Jul 12 13:33:54.609497 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: Content-Length: 0 Jul 12 13:33:54.609497 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: Content-Type: application/json Jul 12 13:33:54.609497 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: Host: 10.222.0.23 Jul 12 13:33:54.609497 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: Openstack-System-Scope: None Jul 12 13:33:54.609497 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: User-Agent: python-urllib3/1.26.9 Jul 12 13:33:54.609497 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Auth-Token: gAAAAABizXbHaqiAqZhWBI-vk_o7a-bGHsret_K3_OESrsSqXK-GPMz9bPJQcG7LrA86KpPc4AMrjwGTn_JiGdYdVtYddlqLRSDG3IHGj5eQPo9N843Dt2ruWjpHNFsSPymDgsCEgYLfMLp_zHvOn_zPoeXgUvrsNthFZ_9cbS3sn5NZOuhEk88 Jul 12 13:33:54.609497 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Domain-Id: None Jul 12 13:33:54.609497 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Domain-Name: None Jul 12 13:33:54.609497 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Identity-Status: Confirmed Jul 12 13:33:54.609497 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Is-Admin-Project: True Jul 12 13:33:54.609497 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Project-Domain-Id: default Jul 12 13:33:54.609497 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Project-Domain-Name: Default Jul 12 13:33:54.609497 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Project-Id: 2c27fe465e6743e19feec424e6e9f3d1 Jul 12 13:33:54.609497 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-115734551 Jul 12 13:33:54.609497 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Role: reader,member Jul 12 13:33:54.609497 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Roles: reader,member Jul 12 13:33:54.611043 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2c27fe465e6743e19feec424e6e9f3d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2c27fe465e6743e19feec424e6e9f3d1", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2c27fe465e6743e19feec424e6e9f3d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2c27fe465e6743e19feec424e6e9f3d1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] Jul 12 13:33:54.611043 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Tenant: tempest-ServerRescueNegativeTestJSON-115734551 Jul 12 13:33:54.611043 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Tenant-Id: 2c27fe465e6743e19feec424e6e9f3d1 Jul 12 13:33:54.611043 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-115734551 Jul 12 13:33:54.611043 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-User: tempest-ServerRescueNegativeTestJSON-115734551-project Jul 12 13:33:54.611043 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-User-Domain-Id: default Jul 12 13:33:54.611043 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-User-Domain-Name: Default Jul 12 13:33:54.611043 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-User-Id: 8f448776d1074e22bfe6cfbe05e01db7 Jul 12 13:33:54.611043 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-User-Name: tempest-ServerRescueNegativeTestJSON-115734551-project Jul 12 13:33:54.611043 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: method: > Jul 12 13:33:54.611043 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: exception: Cannot 'detach_volume' instance 5982cf25-982e-4787-8992-63184a0dd50f while it is in vm_state rescued Jul 12 13:33:54.611921 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: action_args: {'server_id': '5982cf25-982e-4787-8992-63184a0dd50f', 'id': 'd5f4335b-7712-4da4-ab0f-002f9fff8c1e'} Jul 12 13:33:54.611921 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 13:33:54.611921 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:33:54.611921 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 12 13:33:54.611921 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 12 13:33:54.611921 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 12 13:33:54.611921 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 12 13:33:54.611921 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 12 13:33:54.611921 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 12 13:33:54.611921 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 5982cf25-982e-4787-8992-63184a0dd50f in vm_state rescued. Cannot detach_volume while the instance is in this state. Jul 12 13:33:54.611921 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi Jul 12 13:33:54.611921 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:33:54.611921 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi Jul 12 13:33:54.611921 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:33:54.611921 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:33:54.611921 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:33:54.611921 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 13:33:54.611921 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 13:33:54.611921 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 13:33:54.611921 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:33:54.613498 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jul 12 13:33:54.613498 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 12 13:33:54.613498 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 12 13:33:54.613498 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 12 13:33:54.613498 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 5982cf25-982e-4787-8992-63184a0dd50f while it is in vm_state rescued Jul 12 13:33:54.613498 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi Jul 12 13:33:54.613498 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:33:54.613498 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi Jul 12 13:33:54.613498 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:33:54.613498 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:33:54.613498 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:33:54.613498 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 13:33:54.613498 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 13:33:54.613498 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 5982cf25-982e-4787-8992-63184a0dd50f while it is in vm_state rescued Jul 12 13:33:54.613498 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi Jul 12 13:33:54.613498 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-43bf4ea9-84fc-41ce-bd86-325c7597f965 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Returning 409 to user: Cannot 'detach_volume' instance 5982cf25-982e-4787-8992-63184a0dd50f while it is in vm_state rescued {{(pid=117988) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 13:33:54.614735 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-43bf4ea9-84fc-41ce-bd86-325c7597f965 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "DELETE /compute/v2.1/servers/5982cf25-982e-4787-8992-63184a0dd50f/os-volume_attachments/d5f4335b-7712-4da4-ab0f-002f9fff8c1e" status: 409 len: 152 microversion: 2.1 time: 0.107508 Jul 12 13:33:54.614735 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 295/584] 10.222.0.23 () {58 vars in 1415 bytes} [Tue Jul 12 13:33:54 2022] DELETE /compute/v2.1/servers/5982cf25-982e-4787-8992-63184a0dd50f/os-volume_attachments/d5f4335b-7712-4da4-ab0f-002f9fff8c1e => generated 152 bytes in 109 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 12 13:33:54.619940 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-a1281b6f-39ba-43b1-b648-9a56c4697e06 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:33:54.620493 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-a1281b6f-39ba-43b1-b648-9a56c4697e06 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: 5982cf25-982e-4787-8992-63184a0dd50f] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:33:54.627124 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-a1281b6f-39ba-43b1-b648-9a56c4697e06 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:33:54.627577 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-a1281b6f-39ba-43b1-b648-9a56c4697e06 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:33:54.628334 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-a1281b6f-39ba-43b1-b648-9a56c4697e06 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:33:54.628764 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-a1281b6f-39ba-43b1-b648-9a56c4697e06 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:33:54.696813 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-a1281b6f-39ba-43b1-b648-9a56c4697e06 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "POST /compute/v2.1/servers/5982cf25-982e-4787-8992-63184a0dd50f/action" status: 202 len: 0 microversion: 2.1 time: 0.080531 Jul 12 13:33:54.697563 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 290/585] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jul 12 13:33:54 2022] POST /compute/v2.1/servers/5982cf25-982e-4787-8992-63184a0dd50f/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 13:33:54.706524 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-c11c7e51-3719-4e86-8421-d3fa93c5d116 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:33:54.707146 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-c11c7e51-3719-4e86-8421-d3fa93c5d116 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: 5982cf25-982e-4787-8992-63184a0dd50f] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:33:54.713256 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-c11c7e51-3719-4e86-8421-d3fa93c5d116 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:33:54.713745 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-c11c7e51-3719-4e86-8421-d3fa93c5d116 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:33:54.714518 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-c11c7e51-3719-4e86-8421-d3fa93c5d116 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:33:54.714953 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-c11c7e51-3719-4e86-8421-d3fa93c5d116 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:33:54.856388 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-c11c7e51-3719-4e86-8421-d3fa93c5d116 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f448776d1074e22bfe6cfbe05e01db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27fe465e6743e19feec424e6e9f3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:33:54.865732 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-c11c7e51-3719-4e86-8421-d3fa93c5d116 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "GET /compute/v2.1/servers/5982cf25-982e-4787-8992-63184a0dd50f" status: 200 len: 1725 microversion: 2.1 time: 0.163157 Jul 12 13:33:54.866310 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 296/586] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:33:54 2022] GET /compute/v2.1/servers/5982cf25-982e-4787-8992-63184a0dd50f => generated 1725 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:33:55.264560 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-2fda8ae6-2bad-4978-9079-98c33ca5303f tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:33:55.265286 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-2fda8ae6-2bad-4978-9079-98c33ca5303f tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] [instance: a950219a-3350-49e1-ac49-2da471d9b327] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:33:55.271762 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-2fda8ae6-2bad-4978-9079-98c33ca5303f tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:33:55.272214 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-2fda8ae6-2bad-4978-9079-98c33ca5303f tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:33:55.272983 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-2fda8ae6-2bad-4978-9079-98c33ca5303f tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:33:55.273437 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-2fda8ae6-2bad-4978-9079-98c33ca5303f tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:33:55.414548 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-2fda8ae6-2bad-4978-9079-98c33ca5303f tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa0b8a0b7ff4eb0b13fb985dc0d710a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3897c86b8c847ea9091f3c7ad344fa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:33:55.418103 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG dbcounter [-] [117987] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117987) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:33:55.423991 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-2fda8ae6-2bad-4978-9079-98c33ca5303f tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] 10.222.0.23 "GET /compute/v2.1/servers/a950219a-3350-49e1-ac49-2da471d9b327" status: 200 len: 1266 microversion: 2.1 time: 0.164376 Jul 12 13:33:55.424591 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 291/587] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:33:55 2022] GET /compute/v2.1/servers/a950219a-3350-49e1-ac49-2da471d9b327 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:33:55.883423 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-a983f2a0-1951-4b8b-abe9-fc8ad15b7b50 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:33:55.883973 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-a983f2a0-1951-4b8b-abe9-fc8ad15b7b50 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: 5982cf25-982e-4787-8992-63184a0dd50f] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:33:55.891296 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-a983f2a0-1951-4b8b-abe9-fc8ad15b7b50 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:33:55.891740 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-a983f2a0-1951-4b8b-abe9-fc8ad15b7b50 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:33:55.892590 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-a983f2a0-1951-4b8b-abe9-fc8ad15b7b50 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:33:55.892940 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-a983f2a0-1951-4b8b-abe9-fc8ad15b7b50 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:33:56.026914 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-a983f2a0-1951-4b8b-abe9-fc8ad15b7b50 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f448776d1074e22bfe6cfbe05e01db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27fe465e6743e19feec424e6e9f3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:33:56.035834 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-a983f2a0-1951-4b8b-abe9-fc8ad15b7b50 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "GET /compute/v2.1/servers/5982cf25-982e-4787-8992-63184a0dd50f" status: 200 len: 1725 microversion: 2.1 time: 0.156391 Jul 12 13:33:56.036408 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 297/588] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:33:55 2022] GET /compute/v2.1/servers/5982cf25-982e-4787-8992-63184a0dd50f => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:33:56.441039 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-92b702f1-3a4a-46c8-8fa7-480d6255312b tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:33:56.441669 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-92b702f1-3a4a-46c8-8fa7-480d6255312b tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] [instance: a950219a-3350-49e1-ac49-2da471d9b327] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:33:56.448689 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-92b702f1-3a4a-46c8-8fa7-480d6255312b tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:33:56.449126 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-92b702f1-3a4a-46c8-8fa7-480d6255312b tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:33:56.449904 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-92b702f1-3a4a-46c8-8fa7-480d6255312b tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:33:56.450331 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-92b702f1-3a4a-46c8-8fa7-480d6255312b tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:33:56.589098 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-92b702f1-3a4a-46c8-8fa7-480d6255312b tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa0b8a0b7ff4eb0b13fb985dc0d710a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3897c86b8c847ea9091f3c7ad344fa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:33:56.597114 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-92b702f1-3a4a-46c8-8fa7-480d6255312b tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] 10.222.0.23 "GET /compute/v2.1/servers/a950219a-3350-49e1-ac49-2da471d9b327" status: 200 len: 1452 microversion: 2.1 time: 0.160963 Jul 12 13:33:56.597774 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 292/589] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:33:56 2022] GET /compute/v2.1/servers/a950219a-3350-49e1-ac49-2da471d9b327 => generated 1452 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:33:56.616563 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-6a0fab32-0d12-4b7d-bfbc-37b457e5963a tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:33:56.617686 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-6a0fab32-0d12-4b7d-bfbc-37b457e5963a tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] [instance: a950219a-3350-49e1-ac49-2da471d9b327] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:33:56.627145 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-6a0fab32-0d12-4b7d-bfbc-37b457e5963a tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:33:56.627878 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-6a0fab32-0d12-4b7d-bfbc-37b457e5963a tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:33:56.629076 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-6a0fab32-0d12-4b7d-bfbc-37b457e5963a tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:33:56.629834 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-6a0fab32-0d12-4b7d-bfbc-37b457e5963a tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:33:56.768387 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-6a0fab32-0d12-4b7d-bfbc-37b457e5963a tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa0b8a0b7ff4eb0b13fb985dc0d710a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3897c86b8c847ea9091f3c7ad344fa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:33:56.776182 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-6a0fab32-0d12-4b7d-bfbc-37b457e5963a tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] 10.222.0.23 "GET /compute/v2.1/servers/a950219a-3350-49e1-ac49-2da471d9b327" status: 200 len: 1452 microversion: 2.1 time: 0.166139 Jul 12 13:33:56.776679 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 298/590] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:33:56 2022] GET /compute/v2.1/servers/a950219a-3350-49e1-ac49-2da471d9b327 => generated 1452 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:33:57.054778 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-2970398b-915f-4f71-a393-5eb701ef5680 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:33:57.055424 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-2970398b-915f-4f71-a393-5eb701ef5680 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: 5982cf25-982e-4787-8992-63184a0dd50f] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:33:57.062218 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-2970398b-915f-4f71-a393-5eb701ef5680 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:33:57.062741 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-2970398b-915f-4f71-a393-5eb701ef5680 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:33:57.063572 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-2970398b-915f-4f71-a393-5eb701ef5680 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:33:57.064074 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-2970398b-915f-4f71-a393-5eb701ef5680 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:33:57.196737 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-2970398b-915f-4f71-a393-5eb701ef5680 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f448776d1074e22bfe6cfbe05e01db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27fe465e6743e19feec424e6e9f3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:33:57.205126 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-2970398b-915f-4f71-a393-5eb701ef5680 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "GET /compute/v2.1/servers/5982cf25-982e-4787-8992-63184a0dd50f" status: 200 len: 1725 microversion: 2.1 time: 0.154320 Jul 12 13:33:57.205966 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 293/591] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:33:57 2022] GET /compute/v2.1/servers/5982cf25-982e-4787-8992-63184a0dd50f => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:33:58.222800 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-f76cb0fe-4182-4c50-af73-25e2531840f2 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:33:58.223449 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-f76cb0fe-4182-4c50-af73-25e2531840f2 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: 5982cf25-982e-4787-8992-63184a0dd50f] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:33:58.236400 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-f76cb0fe-4182-4c50-af73-25e2531840f2 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:33:58.236852 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-f76cb0fe-4182-4c50-af73-25e2531840f2 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:33:58.237669 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-f76cb0fe-4182-4c50-af73-25e2531840f2 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:33:58.238112 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-f76cb0fe-4182-4c50-af73-25e2531840f2 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:33:58.376646 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-f76cb0fe-4182-4c50-af73-25e2531840f2 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f448776d1074e22bfe6cfbe05e01db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27fe465e6743e19feec424e6e9f3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:33:58.385297 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-f76cb0fe-4182-4c50-af73-25e2531840f2 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "GET /compute/v2.1/servers/5982cf25-982e-4787-8992-63184a0dd50f" status: 200 len: 1725 microversion: 2.1 time: 0.166328 Jul 12 13:33:58.385942 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 299/592] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:33:58 2022] GET /compute/v2.1/servers/5982cf25-982e-4787-8992-63184a0dd50f => generated 1725 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:33:58.689115 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [req-4a873280-27ac-4fe6-b15c-98b25bc6cf47 req-c87e36c5-4fb1-4c82-8df9-f8787fde2ef0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a950219a-3350-49e1-ac49-2da471d9b327", "tag": "f664b5fd-68ee-4047-bbea-3717c70b4099"}]} {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:33:58.698190 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [req-4a873280-27ac-4fe6-b15c-98b25bc6cf47 req-c87e36c5-4fb1-4c82-8df9-f8787fde2ef0 service nova] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:33:58.698638 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [req-4a873280-27ac-4fe6-b15c-98b25bc6cf47 req-c87e36c5-4fb1-4c82-8df9-f8787fde2ef0 service nova] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:33:58.710316 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.compute.server_external_events [req-4a873280-27ac-4fe6-b15c-98b25bc6cf47 req-c87e36c5-4fb1-4c82-8df9-f8787fde2ef0 service nova] Creating event network-changed:f664b5fd-68ee-4047-bbea-3717c70b4099 for instance a950219a-3350-49e1-ac49-2da471d9b327 on hv-cinder-82002 Jul 12 13:33:58.715218 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [req-4a873280-27ac-4fe6-b15c-98b25bc6cf47 req-c87e36c5-4fb1-4c82-8df9-f8787fde2ef0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030580 Jul 12 13:33:58.716003 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 294/593] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 12 13:33:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:33:59.402692 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-c4cf8ccc-ab85-4729-8995-0fddc37d2768 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:33:59.403312 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-c4cf8ccc-ab85-4729-8995-0fddc37d2768 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: 5982cf25-982e-4787-8992-63184a0dd50f] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:33:59.410776 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-c4cf8ccc-ab85-4729-8995-0fddc37d2768 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:33:59.411229 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-c4cf8ccc-ab85-4729-8995-0fddc37d2768 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:33:59.412007 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-c4cf8ccc-ab85-4729-8995-0fddc37d2768 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:33:59.412443 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-c4cf8ccc-ab85-4729-8995-0fddc37d2768 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:33:59.433286 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG dbcounter [-] [117988] Writing DB stats nova_cell1:SELECT=100 {{(pid=117988) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:33:59.583105 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-c4cf8ccc-ab85-4729-8995-0fddc37d2768 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f448776d1074e22bfe6cfbe05e01db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27fe465e6743e19feec424e6e9f3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:33:59.593291 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-c4cf8ccc-ab85-4729-8995-0fddc37d2768 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "GET /compute/v2.1/servers/5982cf25-982e-4787-8992-63184a0dd50f" status: 200 len: 1731 microversion: 2.1 time: 0.194413 Jul 12 13:33:59.595436 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 300/594] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:33:59 2022] GET /compute/v2.1/servers/5982cf25-982e-4787-8992-63184a0dd50f => generated 1731 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:33:59.619544 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-9639ca57-24ee-4c28-9333-a9c1d492d65a tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:33:59.620251 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-9639ca57-24ee-4c28-9333-a9c1d492d65a tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: 5982cf25-982e-4787-8992-63184a0dd50f] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:33:59.627543 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-9639ca57-24ee-4c28-9333-a9c1d492d65a tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:33:59.628113 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-9639ca57-24ee-4c28-9333-a9c1d492d65a tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:33:59.628966 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-9639ca57-24ee-4c28-9333-a9c1d492d65a tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:33:59.629497 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-9639ca57-24ee-4c28-9333-a9c1d492d65a tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:33:59.720747 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-9639ca57-24ee-4c28-9333-a9c1d492d65a tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "GET /compute/v2.1/servers/5982cf25-982e-4787-8992-63184a0dd50f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.105404 Jul 12 13:33:59.722598 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 295/595] 10.222.0.23 () {58 vars in 1274 bytes} [Tue Jul 12 13:33:59 2022] GET /compute/v2.1/servers/5982cf25-982e-4787-8992-63184a0dd50f/os-interface => generated 284 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:34:00.949554 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [req-4dfe86b0-041b-4dc5-a373-09382689234d req-eae0c041-beed-4996-8b1a-9422330f2508 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5982cf25-982e-4787-8992-63184a0dd50f", "tag": "48ee5689-784c-4392-88f9-2238b2c24ca3"}]} {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:34:00.958269 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [req-4dfe86b0-041b-4dc5-a373-09382689234d req-eae0c041-beed-4996-8b1a-9422330f2508 service nova] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:34:00.958713 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [req-4dfe86b0-041b-4dc5-a373-09382689234d req-eae0c041-beed-4996-8b1a-9422330f2508 service nova] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:34:00.970557 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.compute.server_external_events [req-4dfe86b0-041b-4dc5-a373-09382689234d req-eae0c041-beed-4996-8b1a-9422330f2508 service nova] Creating event network-changed:48ee5689-784c-4392-88f9-2238b2c24ca3 for instance 5982cf25-982e-4787-8992-63184a0dd50f on hv-cinder-82002 Jul 12 13:34:00.975689 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [req-4dfe86b0-041b-4dc5-a373-09382689234d req-eae0c041-beed-4996-8b1a-9422330f2508 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094162 Jul 12 13:34:00.976579 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 301/596] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 12 13:34:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:34:02.991884 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [req-1b71ce57-7622-48bb-824e-df3a2a889672 req-abf063b1-a9e9-4e8d-9238-773625cf9a28 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5982cf25-982e-4787-8992-63184a0dd50f", "tag": "48ee5689-784c-4392-88f9-2238b2c24ca3"}]} {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:34:03.000932 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [req-1b71ce57-7622-48bb-824e-df3a2a889672 req-abf063b1-a9e9-4e8d-9238-773625cf9a28 service nova] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:34:03.001400 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [req-1b71ce57-7622-48bb-824e-df3a2a889672 req-abf063b1-a9e9-4e8d-9238-773625cf9a28 service nova] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:34:03.013911 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.compute.server_external_events [req-1b71ce57-7622-48bb-824e-df3a2a889672 req-abf063b1-a9e9-4e8d-9238-773625cf9a28 service nova] Creating event network-changed:48ee5689-784c-4392-88f9-2238b2c24ca3 for instance 5982cf25-982e-4787-8992-63184a0dd50f on hv-cinder-82002 Jul 12 13:34:03.018518 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [req-1b71ce57-7622-48bb-824e-df3a2a889672 req-abf063b1-a9e9-4e8d-9238-773625cf9a28 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030734 Jul 12 13:34:03.019080 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 296/597] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 12 13:34:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:34:14.168701 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG dbcounter [-] [117988] Writing DB stats nova_api:SELECT=25 {{(pid=117988) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:34:14.170082 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG dbcounter [-] [117988] Writing DB stats nova_cell1:SELECT=4 {{(pid=117988) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:34:14.174687 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-9f88572c-3f30-4213-86bf-f42b517c4e13 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:34:14.175280 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-9f88572c-3f30-4213-86bf-f42b517c4e13 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 5d30ed54-909d-491f-a14c-bc4435cfdc6f] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:34:14.182365 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-9f88572c-3f30-4213-86bf-f42b517c4e13 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:34:14.182806 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-9f88572c-3f30-4213-86bf-f42b517c4e13 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:34:14.183566 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-9f88572c-3f30-4213-86bf-f42b517c4e13 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:34:14.183997 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-9f88572c-3f30-4213-86bf-f42b517c4e13 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:34:14.215811 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-9f88572c-3f30-4213-86bf-f42b517c4e13 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f/os-volume_attachments/9debd6f8-718d-4d7d-b6d9-c964d4a1c7cb" status: 200 len: 194 microversion: 2.20 time: 0.048703 Jul 12 13:34:14.216481 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 302/598] 10.222.0.23 () {60 vars in 1453 bytes} [Tue Jul 12 13:34:14 2022] GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f/os-volume_attachments/9debd6f8-718d-4d7d-b6d9-c964d4a1c7cb => generated 194 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 13:34:14.285905 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG dbcounter [-] [117987] Writing DB stats nova_api:SELECT=35 {{(pid=117987) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:34:14.286643 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG dbcounter [-] [117987] Writing DB stats nova_cell1:SELECT=20 {{(pid=117987) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:34:14.291259 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-92fd4ef4-33e7-4555-905d-d1fbdcc680c5 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:34:14.291845 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-92fd4ef4-33e7-4555-905d-d1fbdcc680c5 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 5d30ed54-909d-491f-a14c-bc4435cfdc6f] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:34:14.300079 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-92fd4ef4-33e7-4555-905d-d1fbdcc680c5 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:34:14.300529 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-92fd4ef4-33e7-4555-905d-d1fbdcc680c5 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:34:14.301295 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-92fd4ef4-33e7-4555-905d-d1fbdcc680c5 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:34:14.301761 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-92fd4ef4-33e7-4555-905d-d1fbdcc680c5 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:34:14.386007 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.objects.instance [None req-92fd4ef4-33e7-4555-905d-d1fbdcc680c5 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lazy-loading 'services' on Instance uuid 5d30ed54-909d-491f-a14c-bc4435cfdc6f {{(pid=117987) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 13:34:14.464540 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-92fd4ef4-33e7-4555-905d-d1fbdcc680c5 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "DELETE /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f/os-volume_attachments/9debd6f8-718d-4d7d-b6d9-c964d4a1c7cb" status: 202 len: 0 microversion: 2.20 time: 0.179986 Jul 12 13:34:14.465141 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 297/599] 10.222.0.23 () {60 vars in 1456 bytes} [Tue Jul 12 13:34:14 2022] DELETE /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f/os-volume_attachments/9debd6f8-718d-4d7d-b6d9-c964d4a1c7cb => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 12 13:34:14.474219 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-907550b9-2bdb-47f4-a64a-e9449a6dc203 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:34:14.475170 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-907550b9-2bdb-47f4-a64a-e9449a6dc203 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 5d30ed54-909d-491f-a14c-bc4435cfdc6f] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:34:14.481459 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-907550b9-2bdb-47f4-a64a-e9449a6dc203 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:34:14.482547 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-907550b9-2bdb-47f4-a64a-e9449a6dc203 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:34:14.484059 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-907550b9-2bdb-47f4-a64a-e9449a6dc203 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:34:14.484503 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-907550b9-2bdb-47f4-a64a-e9449a6dc203 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:34:14.526016 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-907550b9-2bdb-47f4-a64a-e9449a6dc203 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055758 Jul 12 13:34:14.526613 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 303/600] 10.222.0.23 () {60 vars in 1342 bytes} [Tue Jul 12 13:34:14 2022] GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 13:34:15.540534 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-2d0b0fd8-a959-485e-bb5d-653c54c896dc tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:34:15.541553 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-2d0b0fd8-a959-485e-bb5d-653c54c896dc tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 5d30ed54-909d-491f-a14c-bc4435cfdc6f] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:34:15.551292 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-2d0b0fd8-a959-485e-bb5d-653c54c896dc tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:34:15.551738 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-2d0b0fd8-a959-485e-bb5d-653c54c896dc tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:34:15.552505 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-2d0b0fd8-a959-485e-bb5d-653c54c896dc tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:34:15.553050 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-2d0b0fd8-a959-485e-bb5d-653c54c896dc tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:34:15.586621 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-2d0b0fd8-a959-485e-bb5d-653c54c896dc tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050515 Jul 12 13:34:15.587501 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 298/601] 10.222.0.23 () {60 vars in 1342 bytes} [Tue Jul 12 13:34:15 2022] GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 12 13:34:16.600984 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-5b3b3c94-5112-487f-ae1d-04298065b511 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:34:16.601921 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-5b3b3c94-5112-487f-ae1d-04298065b511 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 5d30ed54-909d-491f-a14c-bc4435cfdc6f] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:34:16.609176 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-5b3b3c94-5112-487f-ae1d-04298065b511 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:34:16.609853 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-5b3b3c94-5112-487f-ae1d-04298065b511 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:34:16.610627 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-5b3b3c94-5112-487f-ae1d-04298065b511 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:34:16.611082 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-5b3b3c94-5112-487f-ae1d-04298065b511 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:34:16.641187 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-5b3b3c94-5112-487f-ae1d-04298065b511 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045401 Jul 12 13:34:16.641784 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 304/602] 10.222.0.23 () {60 vars in 1342 bytes} [Tue Jul 12 13:34:16 2022] GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:34:16.702797 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-f63a6c4d-73bf-452a-bfb8-1551fb80cdd2 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:34:16.703336 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-f63a6c4d-73bf-452a-bfb8-1551fb80cdd2 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 5d30ed54-909d-491f-a14c-bc4435cfdc6f] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:34:16.709764 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-f63a6c4d-73bf-452a-bfb8-1551fb80cdd2 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:34:16.710203 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-f63a6c4d-73bf-452a-bfb8-1551fb80cdd2 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:34:16.710970 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-f63a6c4d-73bf-452a-bfb8-1551fb80cdd2 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:34:16.711406 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-f63a6c4d-73bf-452a-bfb8-1551fb80cdd2 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:34:16.739412 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-f63a6c4d-73bf-452a-bfb8-1551fb80cdd2 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 5d30ed54-909d-491f-a14c-bc4435cfdc6f] Going to try to terminate instance {{(pid=117987) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 13:34:16.823856 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-f63a6c4d-73bf-452a-bfb8-1551fb80cdd2 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "DELETE /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f" status: 204 len: 0 microversion: 2.20 time: 0.125118 Jul 12 13:34:16.824448 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 299/603] 10.222.0.23 () {60 vars in 1279 bytes} [Tue Jul 12 13:34:16 2022] DELETE /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 12 13:34:16.833407 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-7a90e885-e5ef-4538-9a3a-c128a25a213c tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:34:16.834040 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-7a90e885-e5ef-4538-9a3a-c128a25a213c tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 5d30ed54-909d-491f-a14c-bc4435cfdc6f] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:34:16.840054 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-7a90e885-e5ef-4538-9a3a-c128a25a213c tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:34:16.840502 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-7a90e885-e5ef-4538-9a3a-c128a25a213c tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:34:16.841272 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-7a90e885-e5ef-4538-9a3a-c128a25a213c tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:34:16.841734 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-7a90e885-e5ef-4538-9a3a-c128a25a213c tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:34:16.981028 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-7a90e885-e5ef-4538-9a3a-c128a25a213c tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:34:16.989210 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-7a90e885-e5ef-4538-9a3a-c128a25a213c tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:34:16.990753 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-7a90e885-e5ef-4538-9a3a-c128a25a213c tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:34:16.991899 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-7a90e885-e5ef-4538-9a3a-c128a25a213c tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f" status: 200 len: 1724 microversion: 2.20 time: 0.162542 Jul 12 13:34:16.992463 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 305/604] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:34:16 2022] GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:34:18.010953 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-d406a699-b29c-4e16-afc3-7415f9d006a7 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:34:18.011692 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-d406a699-b29c-4e16-afc3-7415f9d006a7 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 5d30ed54-909d-491f-a14c-bc4435cfdc6f] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:34:18.019617 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-d406a699-b29c-4e16-afc3-7415f9d006a7 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:34:18.020058 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-d406a699-b29c-4e16-afc3-7415f9d006a7 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:34:18.020819 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-d406a699-b29c-4e16-afc3-7415f9d006a7 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:34:18.021246 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-d406a699-b29c-4e16-afc3-7415f9d006a7 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:34:18.156986 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-d406a699-b29c-4e16-afc3-7415f9d006a7 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:34:18.165245 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-d406a699-b29c-4e16-afc3-7415f9d006a7 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:34:18.166774 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-d406a699-b29c-4e16-afc3-7415f9d006a7 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:34:18.167917 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-d406a699-b29c-4e16-afc3-7415f9d006a7 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f" status: 200 len: 1724 microversion: 2.20 time: 0.161356 Jul 12 13:34:18.168470 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 300/605] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:34:18 2022] GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:34:19.187675 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-01731fab-90f4-4a0f-8a09-1941e40baac7 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:34:19.188281 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-01731fab-90f4-4a0f-8a09-1941e40baac7 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 5d30ed54-909d-491f-a14c-bc4435cfdc6f] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:34:19.195508 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-01731fab-90f4-4a0f-8a09-1941e40baac7 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:34:19.195951 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-01731fab-90f4-4a0f-8a09-1941e40baac7 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:34:19.196709 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-01731fab-90f4-4a0f-8a09-1941e40baac7 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:34:19.197138 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-01731fab-90f4-4a0f-8a09-1941e40baac7 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:34:19.350609 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-01731fab-90f4-4a0f-8a09-1941e40baac7 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:34:19.362777 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-01731fab-90f4-4a0f-8a09-1941e40baac7 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:34:19.364322 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-01731fab-90f4-4a0f-8a09-1941e40baac7 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:34:19.365547 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-01731fab-90f4-4a0f-8a09-1941e40baac7 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f" status: 200 len: 1724 microversion: 2.20 time: 0.182245 Jul 12 13:34:19.366122 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 306/606] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:34:19 2022] GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f => generated 1724 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:34:20.185280 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [req-914455ae-8ecb-4161-a446-ab2fc4c4fba3 req-cd03bdfc-d7f8-4f01-8407-6f176b6dba32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d30ed54-909d-491f-a14c-bc4435cfdc6f", "name": "network-vif-deleted", "tag": "f13aa237-fefb-4e93-8923-7007031116c1"}]} {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:34:20.195604 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [req-914455ae-8ecb-4161-a446-ab2fc4c4fba3 req-cd03bdfc-d7f8-4f01-8407-6f176b6dba32 service nova] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:34:20.196400 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [req-914455ae-8ecb-4161-a446-ab2fc4c4fba3 req-cd03bdfc-d7f8-4f01-8407-6f176b6dba32 service nova] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:34:20.208866 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.compute.server_external_events [req-914455ae-8ecb-4161-a446-ab2fc4c4fba3 req-cd03bdfc-d7f8-4f01-8407-6f176b6dba32 service nova] Creating event network-vif-deleted:f13aa237-fefb-4e93-8923-7007031116c1 for instance 5d30ed54-909d-491f-a14c-bc4435cfdc6f on hv-cinder-82002 Jul 12 13:34:20.213823 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [req-914455ae-8ecb-4161-a446-ab2fc4c4fba3 req-cd03bdfc-d7f8-4f01-8407-6f176b6dba32 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033289 Jul 12 13:34:20.214895 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 301/607] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 12 13:34:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 13:34:20.385048 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-def029e8-7d25-4452-8593-0c928caa72ff tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:34:20.385788 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-def029e8-7d25-4452-8593-0c928caa72ff tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 5d30ed54-909d-491f-a14c-bc4435cfdc6f] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:34:20.392418 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-def029e8-7d25-4452-8593-0c928caa72ff tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:34:20.392863 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-def029e8-7d25-4452-8593-0c928caa72ff tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:34:20.393656 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-def029e8-7d25-4452-8593-0c928caa72ff tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:34:20.394263 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-def029e8-7d25-4452-8593-0c928caa72ff tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:34:20.429087 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-def029e8-7d25-4452-8593-0c928caa72ff tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:34:20.429812 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-def029e8-7d25-4452-8593-0c928caa72ff tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:34:20.430418 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.objects.instance [None req-def029e8-7d25-4452-8593-0c928caa72ff tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lazy-loading 'fault' on Instance uuid 5d30ed54-909d-491f-a14c-bc4435cfdc6f {{(pid=117988) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 13:34:20.485699 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-def029e8-7d25-4452-8593-0c928caa72ff tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:34:20.498536 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-def029e8-7d25-4452-8593-0c928caa72ff tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:34:20.498536 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-def029e8-7d25-4452-8593-0c928caa72ff tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:34:20.498536 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-def029e8-7d25-4452-8593-0c928caa72ff tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f" status: 200 len: 1371 microversion: 2.20 time: 0.116112 Jul 12 13:34:20.499497 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 307/608] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:34:20 2022] GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f => generated 1371 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 13:34:21.518950 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-c7cdfe6d-e4d5-48ab-91d9-6b3a3cb62f89 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:34:21.519750 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-c7cdfe6d-e4d5-48ab-91d9-6b3a3cb62f89 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 5d30ed54-909d-491f-a14c-bc4435cfdc6f] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:34:21.526776 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-c7cdfe6d-e4d5-48ab-91d9-6b3a3cb62f89 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:34:21.527219 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-c7cdfe6d-e4d5-48ab-91d9-6b3a3cb62f89 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:34:21.527993 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-c7cdfe6d-e4d5-48ab-91d9-6b3a3cb62f89 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:34:21.528453 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-c7cdfe6d-e4d5-48ab-91d9-6b3a3cb62f89 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:34:21.543413 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.wsgi [None req-c7cdfe6d-e4d5-48ab-91d9-6b3a3cb62f89 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] HTTP exception thrown: Instance 5d30ed54-909d-491f-a14c-bc4435cfdc6f could not be found. Jul 12 13:34:21.545064 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-c7cdfe6d-e4d5-48ab-91d9-6b3a3cb62f89 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Request method failure captured: Jul 12 13:34:21.545064 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: request: GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f HTTP/1.1 Jul 12 13:34:21.545064 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: Accept: application/json Jul 12 13:34:21.545064 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: Accept-Encoding: identity Jul 12 13:34:21.545064 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: Connection: close Jul 12 13:34:21.545064 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: Content-Length: 0 Jul 12 13:34:21.545064 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: Content-Type: application/json Jul 12 13:34:21.545064 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: Host: 10.222.0.23 Jul 12 13:34:21.545064 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: Openstack-System-Scope: None Jul 12 13:34:21.545064 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: User-Agent: python-urllib3/1.26.9 Jul 12 13:34:21.545064 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Auth-Token: gAAAAABizXa5Mzz7XbeAlUbBibmdjXsRQH8kciDBYi4bqh4q0wKrsvhAH9LW_48DowcvpXBUdIcNv1inXOw0WH8OaoH7WgasRZSbb5u5_jFGC9PQhs4FZXewQWd-WG1aDUO_uobVsoTerymhu5sjIQ4flyzML7H18U01aD4MkWOrZEjERlqp4CY Jul 12 13:34:21.545064 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Domain-Id: None Jul 12 13:34:21.545064 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Domain-Name: None Jul 12 13:34:21.545064 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Identity-Status: Confirmed Jul 12 13:34:21.545064 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Is-Admin-Project: True Jul 12 13:34:21.545064 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Openstack-Nova-Api-Version: 2.20 Jul 12 13:34:21.545064 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Project-Domain-Id: default Jul 12 13:34:21.545064 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Project-Domain-Name: Default Jul 12 13:34:21.545064 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Project-Id: 0a2414687e6d4a449e3aeec65921b3c4 Jul 12 13:34:21.545064 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1205023784 Jul 12 13:34:21.545064 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Role: reader,member Jul 12 13:34:21.545064 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Roles: reader,member Jul 12 13:34:21.547581 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/0a2414687e6d4a449e3aeec65921b3c4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_0a2414687e6d4a449e3aeec65921b3c4", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0a2414687e6d4a449e3aeec65921b3c4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0a2414687e6d4a449e3aeec65921b3c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] Jul 12 13:34:21.547581 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1205023784 Jul 12 13:34:21.547581 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Tenant-Id: 0a2414687e6d4a449e3aeec65921b3c4 Jul 12 13:34:21.547581 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1205023784 Jul 12 13:34:21.547581 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-User: tempest-AttachVolumeShelveTestJSON-1205023784-project Jul 12 13:34:21.547581 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-User-Domain-Id: default Jul 12 13:34:21.547581 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-User-Domain-Name: Default Jul 12 13:34:21.547581 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-User-Id: f8de4128718d4837af77d427973d30be Jul 12 13:34:21.547581 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1205023784-project Jul 12 13:34:21.547581 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: method: > Jul 12 13:34:21.547581 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: exception: Instance 5d30ed54-909d-491f-a14c-bc4435cfdc6f could not be found. Jul 12 13:34:21.547581 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: action_args: {'id': '5d30ed54-909d-491f-a14c-bc4435cfdc6f'} Jul 12 13:34:21.548522 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 13:34:21.548522 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:34:21.548522 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 13:34:21.548522 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 13:34:21.548522 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 13:34:21.548522 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 13:34:21.548522 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 13:34:21.548522 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 13:34:21.548522 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 13:34:21.548522 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 13:34:21.548522 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d30ed54-909d-491f-a14c-bc4435cfdc6f could not be found. Jul 12 13:34:21.548522 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi Jul 12 13:34:21.548522 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:34:21.548522 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi Jul 12 13:34:21.548522 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:34:21.548522 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:34:21.548522 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:34:21.548522 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 13:34:21.548522 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 13:34:21.548522 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 13:34:21.550069 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:34:21.550069 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 13:34:21.550069 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 13:34:21.550069 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 13:34:21.550069 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 13:34:21.550069 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 13:34:21.550069 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 13:34:21.550069 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d30ed54-909d-491f-a14c-bc4435cfdc6f could not be found. Jul 12 13:34:21.550069 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi Jul 12 13:34:21.550069 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:34:21.550069 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi Jul 12 13:34:21.550069 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:34:21.550069 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:34:21.550069 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:34:21.550069 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 13:34:21.550069 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 13:34:21.550069 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d30ed54-909d-491f-a14c-bc4435cfdc6f could not be found. Jul 12 13:34:21.550069 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi Jul 12 13:34:21.551476 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-c7cdfe6d-e4d5-48ab-91d9-6b3a3cb62f89 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Returning 404 to user: Instance 5d30ed54-909d-491f-a14c-bc4435cfdc6f could not be found. {{(pid=117987) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 13:34:21.551476 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-c7cdfe6d-e4d5-48ab-91d9-6b3a3cb62f89 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f" status: 404 len: 111 microversion: 2.20 time: 0.034587 Jul 12 13:34:21.551476 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 302/609] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:34:21 2022] GET /compute/v2.1/servers/5d30ed54-909d-491f-a14c-bc4435cfdc6f => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 12 13:34:21.556860 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-0912a3ce-59b4-4cf2-8456-7449b005a46d tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '.version_select at 0x7f76ea123f70>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:34:21.590745 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-0912a3ce-59b4-4cf2-8456-7449b005a46d tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-242911539" status: 204 len: 0 microversion: 2.20 time: 0.037705 Jul 12 13:34:21.591333 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 308/610] 10.222.0.23 () {60 vars in 1258 bytes} [Tue Jul 12 13:34:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-242911539 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 12 13:34:22.259206 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-9c1abfab-82ce-4099-8ed2-49a5f2649681 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Action: 'create', calling method: .version_select at 0x7f76e90c0160>, body: {"keypair": {"name": "tempest-keypair-677830266", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG6eSy0IFoc+5yownW63IKYe0vNphKRpFheCtdnTijG+wlGPRRS7rBwEOtDgzMff/NfWrlV5u9yf8eEhmoADb+sKaWP5Z+kcYMb0j3Pu2mh8IMmTOnYAq2KuuipKzq6SNg=="}} {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:34:22.275578 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.quota [None req-9c1abfab-82ce-4099-8ed2-49a5f2649681 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Getting quotas for project 0a2414687e6d4a449e3aeec65921b3c4. Resources: {'key_pairs'} {{(pid=117987) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 13:34:22.279497 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.quota [None req-9c1abfab-82ce-4099-8ed2-49a5f2649681 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Getting quotas for user f8de4128718d4837af77d427973d30be and project 0a2414687e6d4a449e3aeec65921b3c4. Resources: {'key_pairs'} {{(pid=117987) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 13:34:22.303060 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-9c1abfab-82ce-4099-8ed2-49a5f2649681 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.047685 Jul 12 13:34:22.303698 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 303/611] 10.222.0.23 () {62 vars in 1199 bytes} [Tue Jul 12 13:34:22 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 49 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Jul 12 13:34:23.591842 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-12690840-0447-4480-9d23-36b308b66308 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-228117142", "imageRef": "ce5a4b61-4265-43de-a33e-a23a4c9f612d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2eeca288-aa45-4bd8-84bb-42469f011ae8"}], "security_groups": [{"name": "tempest-securitygroup--1220970747"}], "key_name": "tempest-keypair-677830266", "user_data": "}} {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:34:23.700429 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.network.neutron [None req-12690840-0447-4480-9d23-36b308b66308 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] validate_networks() for [('2eeca288-aa45-4bd8-84bb-42469f011ae8', None, None, None, None, None)] {{(pid=117988) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 13:34:24.082196 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.virt.hardware [None req-12690840-0447-4480-9d23-36b308b66308 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Flavor limits 0:0:0 {{(pid=117988) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 13:34:24.082617 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.virt.hardware [None req-12690840-0447-4480-9d23-36b308b66308 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Image limits 0:0:0 {{(pid=117988) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 13:34:24.083080 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.virt.hardware [None req-12690840-0447-4480-9d23-36b308b66308 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Flavor pref 0:0:0 {{(pid=117988) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 13:34:24.083480 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.virt.hardware [None req-12690840-0447-4480-9d23-36b308b66308 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Image pref 0:0:0 {{(pid=117988) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 13:34:24.083883 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.virt.hardware [None req-12690840-0447-4480-9d23-36b308b66308 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117988) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 13:34:24.092715 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-12690840-0447-4480-9d23-36b308b66308 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:34:24.093247 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-12690840-0447-4480-9d23-36b308b66308 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:34:24.094069 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-12690840-0447-4480-9d23-36b308b66308 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:34:24.094498 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-12690840-0447-4480-9d23-36b308b66308 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:34:24.110466 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.quota [None req-12690840-0447-4480-9d23-36b308b66308 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Getting quotas for project 0a2414687e6d4a449e3aeec65921b3c4. Resources: {'ram', 'cores', 'instances'} {{(pid=117988) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 13:34:24.114487 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.quota [None req-12690840-0447-4480-9d23-36b308b66308 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Getting quotas for user f8de4128718d4837af77d427973d30be and project 0a2414687e6d4a449e3aeec65921b3c4. Resources: {'ram', 'cores', 'instances'} {{(pid=117988) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 13:34:24.125708 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-12690840-0447-4480-9d23-36b308b66308 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Going to run 1 instances... {{(pid=117988) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 13:34:24.127894 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-12690840-0447-4480-9d23-36b308b66308 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 90cd5e2a-127d-4329-93ff-1a8dc66cf049] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ce5a4b61-4265-43de-a33e-a23a4c9f612d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117988) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 13:34:24.174868 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-12690840-0447-4480-9d23-36b308b66308 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.587931 Jul 12 13:34:24.175707 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 309/612] 10.222.0.23 () {62 vars in 1187 bytes} [Tue Jul 12 13:34:23 2022] POST /compute/v2.1/servers => generated 402 bytes in 589 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 12 13:34:24.185979 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-81a3d2cc-665a-4193-bb72-330aa3dbb32c tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:34:24.187171 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-81a3d2cc-665a-4193-bb72-330aa3dbb32c tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 90cd5e2a-127d-4329-93ff-1a8dc66cf049] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:34:24.243251 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-81a3d2cc-665a-4193-bb72-330aa3dbb32c tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:34:24.252904 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-81a3d2cc-665a-4193-bb72-330aa3dbb32c tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:34:24.254513 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-81a3d2cc-665a-4193-bb72-330aa3dbb32c tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:34:24.255897 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-81a3d2cc-665a-4193-bb72-330aa3dbb32c tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/90cd5e2a-127d-4329-93ff-1a8dc66cf049" status: 200 len: 1280 microversion: 2.20 time: 0.074362 Jul 12 13:34:24.256470 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 304/613] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:34:24 2022] GET /compute/v2.1/servers/90cd5e2a-127d-4329-93ff-1a8dc66cf049 => generated 1280 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:34:25.274546 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-210e8570-3e39-4c78-a409-7f3ce84cd7ef tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:34:25.275293 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-210e8570-3e39-4c78-a409-7f3ce84cd7ef tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 90cd5e2a-127d-4329-93ff-1a8dc66cf049] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:34:25.283518 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-210e8570-3e39-4c78-a409-7f3ce84cd7ef tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:34:25.283980 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-210e8570-3e39-4c78-a409-7f3ce84cd7ef tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:34:25.284872 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-210e8570-3e39-4c78-a409-7f3ce84cd7ef tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:34:25.285195 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-210e8570-3e39-4c78-a409-7f3ce84cd7ef tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:34:25.354444 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-210e8570-3e39-4c78-a409-7f3ce84cd7ef tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:34:25.365308 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-210e8570-3e39-4c78-a409-7f3ce84cd7ef tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:34:25.366897 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-210e8570-3e39-4c78-a409-7f3ce84cd7ef tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:34:25.368040 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-210e8570-3e39-4c78-a409-7f3ce84cd7ef tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/90cd5e2a-127d-4329-93ff-1a8dc66cf049" status: 200 len: 1340 microversion: 2.20 time: 0.097933 Jul 12 13:34:25.368831 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 310/614] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:34:25 2022] GET /compute/v2.1/servers/90cd5e2a-127d-4329-93ff-1a8dc66cf049 => generated 1340 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:34:26.387006 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-66592579-8471-4188-84fe-8e1b68dda1b6 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:34:26.387882 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-66592579-8471-4188-84fe-8e1b68dda1b6 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 90cd5e2a-127d-4329-93ff-1a8dc66cf049] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:34:26.395975 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-66592579-8471-4188-84fe-8e1b68dda1b6 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:34:26.396673 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-66592579-8471-4188-84fe-8e1b68dda1b6 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:34:26.397712 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-66592579-8471-4188-84fe-8e1b68dda1b6 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:34:26.398146 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-66592579-8471-4188-84fe-8e1b68dda1b6 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:34:26.536797 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-66592579-8471-4188-84fe-8e1b68dda1b6 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:34:26.545944 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-66592579-8471-4188-84fe-8e1b68dda1b6 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:34:26.547673 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-66592579-8471-4188-84fe-8e1b68dda1b6 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:34:26.548905 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-66592579-8471-4188-84fe-8e1b68dda1b6 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/90cd5e2a-127d-4329-93ff-1a8dc66cf049" status: 200 len: 1406 microversion: 2.20 time: 0.166177 Jul 12 13:34:26.549705 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 305/615] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:34:26 2022] GET /compute/v2.1/servers/90cd5e2a-127d-4329-93ff-1a8dc66cf049 => generated 1406 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:34:26.965982 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [req-ffb86c70-9718-4cb7-97c1-1bceb07103cc req-f295beee-3baa-420e-a91b-f48baebd4477 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90cd5e2a-127d-4329-93ff-1a8dc66cf049", "tag": "a1218983-36f0-4e25-9df1-d8f2cdfe2972"}]} {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:34:26.975376 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [req-ffb86c70-9718-4cb7-97c1-1bceb07103cc req-f295beee-3baa-420e-a91b-f48baebd4477 service nova] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:34:26.975770 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [req-ffb86c70-9718-4cb7-97c1-1bceb07103cc req-f295beee-3baa-420e-a91b-f48baebd4477 service nova] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:34:26.990467 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.compute.server_external_events [req-ffb86c70-9718-4cb7-97c1-1bceb07103cc req-f295beee-3baa-420e-a91b-f48baebd4477 service nova] Creating event network-changed:a1218983-36f0-4e25-9df1-d8f2cdfe2972 for instance 90cd5e2a-127d-4329-93ff-1a8dc66cf049 on hv-cinder-82002 Jul 12 13:34:26.995704 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [req-ffb86c70-9718-4cb7-97c1-1bceb07103cc req-f295beee-3baa-420e-a91b-f48baebd4477 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035275 Jul 12 13:34:26.996304 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 311/616] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 12 13:34:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 13:34:27.567486 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-d9de0ab2-cc33-49f6-8238-dca451d26612 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:34:27.568083 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-d9de0ab2-cc33-49f6-8238-dca451d26612 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 90cd5e2a-127d-4329-93ff-1a8dc66cf049] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:34:27.574726 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-d9de0ab2-cc33-49f6-8238-dca451d26612 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:34:27.575171 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-d9de0ab2-cc33-49f6-8238-dca451d26612 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:34:27.575947 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-d9de0ab2-cc33-49f6-8238-dca451d26612 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:34:27.576374 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-d9de0ab2-cc33-49f6-8238-dca451d26612 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:34:27.704483 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-d9de0ab2-cc33-49f6-8238-dca451d26612 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:34:27.712346 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-d9de0ab2-cc33-49f6-8238-dca451d26612 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:34:27.713880 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-d9de0ab2-cc33-49f6-8238-dca451d26612 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:34:27.714984 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-d9de0ab2-cc33-49f6-8238-dca451d26612 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/90cd5e2a-127d-4329-93ff-1a8dc66cf049" status: 200 len: 1406 microversion: 2.20 time: 0.151607 Jul 12 13:34:27.715551 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 306/617] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:34:27 2022] GET /compute/v2.1/servers/90cd5e2a-127d-4329-93ff-1a8dc66cf049 => generated 1406 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:34:28.733142 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-73cc3494-4477-42f3-9579-3d17d2254f1e tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:34:28.734484 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-73cc3494-4477-42f3-9579-3d17d2254f1e tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 90cd5e2a-127d-4329-93ff-1a8dc66cf049] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:34:28.740709 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-73cc3494-4477-42f3-9579-3d17d2254f1e tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:34:28.741149 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-73cc3494-4477-42f3-9579-3d17d2254f1e tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:34:28.741942 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-73cc3494-4477-42f3-9579-3d17d2254f1e tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:34:28.742369 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-73cc3494-4477-42f3-9579-3d17d2254f1e tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:34:28.876630 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-73cc3494-4477-42f3-9579-3d17d2254f1e tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:34:28.884597 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-73cc3494-4477-42f3-9579-3d17d2254f1e tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:34:28.886154 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-73cc3494-4477-42f3-9579-3d17d2254f1e tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:34:28.887269 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-73cc3494-4477-42f3-9579-3d17d2254f1e tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/90cd5e2a-127d-4329-93ff-1a8dc66cf049" status: 200 len: 1406 microversion: 2.20 time: 0.158827 Jul 12 13:34:28.887835 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 312/618] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:34:28 2022] GET /compute/v2.1/servers/90cd5e2a-127d-4329-93ff-1a8dc66cf049 => generated 1406 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:34:29.905746 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-37ac63d3-b240-465f-aa77-94f3c426d695 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:34:29.906352 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-37ac63d3-b240-465f-aa77-94f3c426d695 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 90cd5e2a-127d-4329-93ff-1a8dc66cf049] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:34:29.912837 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-37ac63d3-b240-465f-aa77-94f3c426d695 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:34:29.913279 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-37ac63d3-b240-465f-aa77-94f3c426d695 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:34:29.914071 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-37ac63d3-b240-465f-aa77-94f3c426d695 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:34:29.914501 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-37ac63d3-b240-465f-aa77-94f3c426d695 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:34:30.045223 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-37ac63d3-b240-465f-aa77-94f3c426d695 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:34:30.054217 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-37ac63d3-b240-465f-aa77-94f3c426d695 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:34:30.055877 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-37ac63d3-b240-465f-aa77-94f3c426d695 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:34:30.057003 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-37ac63d3-b240-465f-aa77-94f3c426d695 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/90cd5e2a-127d-4329-93ff-1a8dc66cf049" status: 200 len: 1406 microversion: 2.20 time: 0.155230 Jul 12 13:34:30.057843 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 307/619] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:34:29 2022] GET /compute/v2.1/servers/90cd5e2a-127d-4329-93ff-1a8dc66cf049 => generated 1406 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:34:31.076303 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-c0da1704-00a5-43d0-a73c-5cab1379bf3c tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:34:31.077177 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-c0da1704-00a5-43d0-a73c-5cab1379bf3c tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 90cd5e2a-127d-4329-93ff-1a8dc66cf049] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:34:31.085649 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-c0da1704-00a5-43d0-a73c-5cab1379bf3c tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:34:31.086102 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-c0da1704-00a5-43d0-a73c-5cab1379bf3c tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:34:31.086874 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-c0da1704-00a5-43d0-a73c-5cab1379bf3c tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:34:31.087311 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-c0da1704-00a5-43d0-a73c-5cab1379bf3c tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:34:31.217049 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-c0da1704-00a5-43d0-a73c-5cab1379bf3c tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:34:31.226207 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-c0da1704-00a5-43d0-a73c-5cab1379bf3c tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:34:31.228518 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-c0da1704-00a5-43d0-a73c-5cab1379bf3c tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:34:31.229926 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-c0da1704-00a5-43d0-a73c-5cab1379bf3c tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/90cd5e2a-127d-4329-93ff-1a8dc66cf049" status: 200 len: 1406 microversion: 2.20 time: 0.158087 Jul 12 13:34:31.234951 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 313/620] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:34:31 2022] GET /compute/v2.1/servers/90cd5e2a-127d-4329-93ff-1a8dc66cf049 => generated 1406 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:34:32.248085 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-bd7c731e-fe86-49b8-956b-e8d8d0dda388 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:34:32.249131 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-bd7c731e-fe86-49b8-956b-e8d8d0dda388 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 90cd5e2a-127d-4329-93ff-1a8dc66cf049] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:34:32.257200 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-bd7c731e-fe86-49b8-956b-e8d8d0dda388 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:34:32.257678 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-bd7c731e-fe86-49b8-956b-e8d8d0dda388 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:34:32.258442 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-bd7c731e-fe86-49b8-956b-e8d8d0dda388 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:34:32.258879 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-bd7c731e-fe86-49b8-956b-e8d8d0dda388 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:34:32.398181 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-bd7c731e-fe86-49b8-956b-e8d8d0dda388 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:34:32.406093 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-bd7c731e-fe86-49b8-956b-e8d8d0dda388 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:34:32.407592 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-bd7c731e-fe86-49b8-956b-e8d8d0dda388 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:34:32.408686 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-bd7c731e-fe86-49b8-956b-e8d8d0dda388 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/90cd5e2a-127d-4329-93ff-1a8dc66cf049" status: 200 len: 1406 microversion: 2.20 time: 0.164519 Jul 12 13:34:32.409232 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 308/621] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:34:32 2022] GET /compute/v2.1/servers/90cd5e2a-127d-4329-93ff-1a8dc66cf049 => generated 1406 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:34:33.379106 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [req-4f5ef32a-cd95-426f-b218-5e0733366b4b req-14c15eb2-8060-4e2d-bd6b-383e4a576652 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90cd5e2a-127d-4329-93ff-1a8dc66cf049", "name": "network-vif-plugged", "status": "completed", "tag": "a1218983-36f0-4e25-9df1-d8f2cdfe2972"}]} {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:34:33.387790 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [req-4f5ef32a-cd95-426f-b218-5e0733366b4b req-14c15eb2-8060-4e2d-bd6b-383e4a576652 service nova] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:34:33.388361 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [req-4f5ef32a-cd95-426f-b218-5e0733366b4b req-14c15eb2-8060-4e2d-bd6b-383e4a576652 service nova] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:34:33.401479 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.compute.server_external_events [req-4f5ef32a-cd95-426f-b218-5e0733366b4b req-14c15eb2-8060-4e2d-bd6b-383e4a576652 service nova] Creating event network-vif-plugged:a1218983-36f0-4e25-9df1-d8f2cdfe2972 for instance 90cd5e2a-127d-4329-93ff-1a8dc66cf049 on hv-cinder-82002 Jul 12 13:34:33.407666 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [req-4f5ef32a-cd95-426f-b218-5e0733366b4b req-14c15eb2-8060-4e2d-bd6b-383e4a576652 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032758 Jul 12 13:34:33.408272 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 314/622] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 12 13:34:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:34:33.426625 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-4045b6e4-2518-483e-a3f5-20d9b590829f tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:34:33.427243 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-4045b6e4-2518-483e-a3f5-20d9b590829f tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 90cd5e2a-127d-4329-93ff-1a8dc66cf049] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:34:33.433823 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-4045b6e4-2518-483e-a3f5-20d9b590829f tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:34:33.434279 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-4045b6e4-2518-483e-a3f5-20d9b590829f tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:34:33.435050 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-4045b6e4-2518-483e-a3f5-20d9b590829f tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:34:33.435483 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-4045b6e4-2518-483e-a3f5-20d9b590829f tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:34:33.577433 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-4045b6e4-2518-483e-a3f5-20d9b590829f tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:34:33.586395 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-4045b6e4-2518-483e-a3f5-20d9b590829f tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:34:33.588054 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-4045b6e4-2518-483e-a3f5-20d9b590829f tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:34:33.589164 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-4045b6e4-2518-483e-a3f5-20d9b590829f tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/90cd5e2a-127d-4329-93ff-1a8dc66cf049" status: 200 len: 1406 microversion: 2.20 time: 0.166589 Jul 12 13:34:33.589841 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 309/623] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:34:33 2022] GET /compute/v2.1/servers/90cd5e2a-127d-4329-93ff-1a8dc66cf049 => generated 1406 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:34:34.608301 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-092a0f22-23ea-46e3-aa5e-61844bf65ae7 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:34:34.609651 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-092a0f22-23ea-46e3-aa5e-61844bf65ae7 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 90cd5e2a-127d-4329-93ff-1a8dc66cf049] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:34:34.612045 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG dbcounter [-] [117988] Writing DB stats nova_cell0:SELECT=2 {{(pid=117988) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:34:34.613248 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG dbcounter [-] [117988] Writing DB stats nova_cell0:SELECT=6 {{(pid=117988) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:34:34.620699 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-092a0f22-23ea-46e3-aa5e-61844bf65ae7 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:34:34.621215 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-092a0f22-23ea-46e3-aa5e-61844bf65ae7 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:34:34.622034 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-092a0f22-23ea-46e3-aa5e-61844bf65ae7 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:34:34.622575 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-092a0f22-23ea-46e3-aa5e-61844bf65ae7 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:34:34.759192 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-092a0f22-23ea-46e3-aa5e-61844bf65ae7 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:34:34.769082 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-092a0f22-23ea-46e3-aa5e-61844bf65ae7 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:34:34.770940 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-092a0f22-23ea-46e3-aa5e-61844bf65ae7 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:34:34.772397 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-092a0f22-23ea-46e3-aa5e-61844bf65ae7 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/90cd5e2a-127d-4329-93ff-1a8dc66cf049" status: 200 len: 1406 microversion: 2.20 time: 0.168141 Jul 12 13:34:34.773066 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 315/624] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:34:34 2022] GET /compute/v2.1/servers/90cd5e2a-127d-4329-93ff-1a8dc66cf049 => generated 1406 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:34:35.799310 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-e9b640fd-5252-415f-81ff-482defc93f80 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:34:35.800104 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-e9b640fd-5252-415f-81ff-482defc93f80 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 90cd5e2a-127d-4329-93ff-1a8dc66cf049] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:34:35.802122 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG dbcounter [-] [117987] Writing DB stats nova_cell0:SELECT=6 {{(pid=117987) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:34:35.807870 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-e9b640fd-5252-415f-81ff-482defc93f80 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:34:35.808337 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-e9b640fd-5252-415f-81ff-482defc93f80 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:34:35.809118 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-e9b640fd-5252-415f-81ff-482defc93f80 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:34:35.809593 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-e9b640fd-5252-415f-81ff-482defc93f80 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:34:35.950607 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-e9b640fd-5252-415f-81ff-482defc93f80 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:34:35.960664 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-e9b640fd-5252-415f-81ff-482defc93f80 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:34:35.962226 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-e9b640fd-5252-415f-81ff-482defc93f80 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:34:35.963392 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-e9b640fd-5252-415f-81ff-482defc93f80 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/90cd5e2a-127d-4329-93ff-1a8dc66cf049" status: 200 len: 1598 microversion: 2.20 time: 0.171317 Jul 12 13:34:35.963944 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 310/625] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:34:35 2022] GET /compute/v2.1/servers/90cd5e2a-127d-4329-93ff-1a8dc66cf049 => generated 1598 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:34:35.991598 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-911be4d8-e146-4898-bc1e-748eb85055e0 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:34:35.992170 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-911be4d8-e146-4898-bc1e-748eb85055e0 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 90cd5e2a-127d-4329-93ff-1a8dc66cf049] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:34:35.999429 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-911be4d8-e146-4898-bc1e-748eb85055e0 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:34:36.000480 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-911be4d8-e146-4898-bc1e-748eb85055e0 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:34:36.001256 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-911be4d8-e146-4898-bc1e-748eb85055e0 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:34:36.001724 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-911be4d8-e146-4898-bc1e-748eb85055e0 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:34:36.083015 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-911be4d8-e146-4898-bc1e-748eb85055e0 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/90cd5e2a-127d-4329-93ff-1a8dc66cf049/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.095707 Jul 12 13:34:36.083603 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 316/626] 10.222.0.23 () {60 vars in 1315 bytes} [Tue Jul 12 13:34:35 2022] GET /compute/v2.1/servers/90cd5e2a-127d-4329-93ff-1a8dc66cf049/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 13:34:37.173147 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [req-5238257e-c5c1-460b-9fc6-c385e276704d req-e77a7548-3928-401d-80d3-750aa5f45167 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90cd5e2a-127d-4329-93ff-1a8dc66cf049", "tag": "a1218983-36f0-4e25-9df1-d8f2cdfe2972"}]} {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:34:37.183532 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [req-5238257e-c5c1-460b-9fc6-c385e276704d req-e77a7548-3928-401d-80d3-750aa5f45167 service nova] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:34:37.184222 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [req-5238257e-c5c1-460b-9fc6-c385e276704d req-e77a7548-3928-401d-80d3-750aa5f45167 service nova] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:34:37.196427 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.compute.server_external_events [req-5238257e-c5c1-460b-9fc6-c385e276704d req-e77a7548-3928-401d-80d3-750aa5f45167 service nova] Creating event network-changed:a1218983-36f0-4e25-9df1-d8f2cdfe2972 for instance 90cd5e2a-127d-4329-93ff-1a8dc66cf049 on hv-cinder-82002 Jul 12 13:34:37.201714 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [req-5238257e-c5c1-460b-9fc6-c385e276704d req-e77a7548-3928-401d-80d3-750aa5f45167 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032282 Jul 12 13:34:37.203466 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 311/627] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 12 13:34:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:34:46.230077 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG dbcounter [-] [117988] Writing DB stats nova_api:SELECT=46,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117988) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:34:46.230917 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG dbcounter [-] [117988] Writing DB stats nova_cell1:SELECT=72 {{(pid=117988) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:34:46.235178 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-7a40a6d9-9525-4dad-84c3-a9296400fe5c tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:34:46.236086 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-7a40a6d9-9525-4dad-84c3-a9296400fe5c tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] [instance: eeb0b554-cd09-49b5-95f0-22fc7c707944] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:34:46.243353 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-7a40a6d9-9525-4dad-84c3-a9296400fe5c tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:34:46.243801 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-7a40a6d9-9525-4dad-84c3-a9296400fe5c tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:34:46.244571 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-7a40a6d9-9525-4dad-84c3-a9296400fe5c tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:34:46.244998 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-7a40a6d9-9525-4dad-84c3-a9296400fe5c tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:34:46.276968 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-7a40a6d9-9525-4dad-84c3-a9296400fe5c tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] 10.222.0.23 "GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048364 Jul 12 13:34:46.277663 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 317/628] 10.222.0.23 () {58 vars in 1301 bytes} [Tue Jul 12 13:34:46 2022] GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 12 13:34:46.338881 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-e2ed174c-4fd7-4f57-8163-d6e9b3e29e48 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:34:46.339459 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-e2ed174c-4fd7-4f57-8163-d6e9b3e29e48 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] [instance: eeb0b554-cd09-49b5-95f0-22fc7c707944] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:34:46.342090 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG dbcounter [-] [117987] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=117987) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:34:46.348960 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-e2ed174c-4fd7-4f57-8163-d6e9b3e29e48 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:34:46.349436 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-e2ed174c-4fd7-4f57-8163-d6e9b3e29e48 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:34:46.350208 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-e2ed174c-4fd7-4f57-8163-d6e9b3e29e48 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:34:46.350646 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-e2ed174c-4fd7-4f57-8163-d6e9b3e29e48 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:34:46.353848 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG dbcounter [-] [117987] Writing DB stats nova_cell1:SELECT=78,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117987) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:34:46.378785 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-e2ed174c-4fd7-4f57-8163-d6e9b3e29e48 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] [instance: eeb0b554-cd09-49b5-95f0-22fc7c707944] Going to try to terminate instance {{(pid=117987) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 13:34:46.455666 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-e2ed174c-4fd7-4f57-8163-d6e9b3e29e48 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] 10.222.0.23 "DELETE /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944" status: 204 len: 0 microversion: 2.1 time: 0.120533 Jul 12 13:34:46.456519 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 312/629] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 12 13:34:46 2022] DELETE /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 13:34:46.464600 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-5e545d92-3def-4762-96e7-59beb3601741 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:34:46.465205 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-5e545d92-3def-4762-96e7-59beb3601741 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] [instance: eeb0b554-cd09-49b5-95f0-22fc7c707944] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:34:46.471778 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-5e545d92-3def-4762-96e7-59beb3601741 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:34:46.472223 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-5e545d92-3def-4762-96e7-59beb3601741 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:34:46.472980 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-5e545d92-3def-4762-96e7-59beb3601741 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:34:46.473467 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-5e545d92-3def-4762-96e7-59beb3601741 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:34:46.616077 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-5e545d92-3def-4762-96e7-59beb3601741 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b710bbdf0c4d58b4f3ee7ef7410c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8fca4ab6ed466a864c5551fea5f7ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:34:46.623556 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-5e545d92-3def-4762-96e7-59beb3601741 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] 10.222.0.23 "GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944" status: 200 len: 1675 microversion: 2.1 time: 0.162809 Jul 12 13:34:46.624125 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 318/630] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:34:46 2022] GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944 => generated 1675 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:34:47.642182 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-c010260b-1025-4654-8b39-ff66908b8626 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:34:47.643035 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-c010260b-1025-4654-8b39-ff66908b8626 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] [instance: eeb0b554-cd09-49b5-95f0-22fc7c707944] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:34:47.649523 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-c010260b-1025-4654-8b39-ff66908b8626 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:34:47.649977 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-c010260b-1025-4654-8b39-ff66908b8626 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:34:47.650771 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-c010260b-1025-4654-8b39-ff66908b8626 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:34:47.651211 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-c010260b-1025-4654-8b39-ff66908b8626 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:34:47.807015 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-c010260b-1025-4654-8b39-ff66908b8626 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b710bbdf0c4d58b4f3ee7ef7410c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8fca4ab6ed466a864c5551fea5f7ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:34:47.814677 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-c010260b-1025-4654-8b39-ff66908b8626 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] 10.222.0.23 "GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944" status: 200 len: 1675 microversion: 2.1 time: 0.177010 Jul 12 13:34:47.815244 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 313/631] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:34:47 2022] GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944 => generated 1675 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:34:48.759052 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [req-c7f5fa11-6f66-4825-9a5f-abe25777d943 req-2aa39ccc-c3c3-4f1c-b09c-3763fa19bbb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eeb0b554-cd09-49b5-95f0-22fc7c707944", "name": "network-vif-deleted", "tag": "1611c489-7c46-47eb-9b57-cd5d00147d26"}]} {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:34:48.773884 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [req-c7f5fa11-6f66-4825-9a5f-abe25777d943 req-2aa39ccc-c3c3-4f1c-b09c-3763fa19bbb5 service nova] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:34:48.774722 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [req-c7f5fa11-6f66-4825-9a5f-abe25777d943 req-2aa39ccc-c3c3-4f1c-b09c-3763fa19bbb5 service nova] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:34:48.788524 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.compute.server_external_events [req-c7f5fa11-6f66-4825-9a5f-abe25777d943 req-2aa39ccc-c3c3-4f1c-b09c-3763fa19bbb5 service nova] Creating event network-vif-deleted:1611c489-7c46-47eb-9b57-cd5d00147d26 for instance eeb0b554-cd09-49b5-95f0-22fc7c707944 on hv-cinder-82002 Jul 12 13:34:48.795064 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [req-c7f5fa11-6f66-4825-9a5f-abe25777d943 req-2aa39ccc-c3c3-4f1c-b09c-3763fa19bbb5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042514 Jul 12 13:34:48.796838 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 319/632] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 12 13:34:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:34:48.839320 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-50015252-a723-45ce-a52e-7cd12c1e3ae9 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:34:48.840722 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-50015252-a723-45ce-a52e-7cd12c1e3ae9 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] [instance: eeb0b554-cd09-49b5-95f0-22fc7c707944] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:34:48.848243 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-50015252-a723-45ce-a52e-7cd12c1e3ae9 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:34:48.849234 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-50015252-a723-45ce-a52e-7cd12c1e3ae9 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:34:48.850273 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-50015252-a723-45ce-a52e-7cd12c1e3ae9 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:34:48.851072 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-50015252-a723-45ce-a52e-7cd12c1e3ae9 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:34:48.931656 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-50015252-a723-45ce-a52e-7cd12c1e3ae9 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b710bbdf0c4d58b4f3ee7ef7410c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8fca4ab6ed466a864c5551fea5f7ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:34:48.941509 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-50015252-a723-45ce-a52e-7cd12c1e3ae9 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] 10.222.0.23 "GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944" status: 200 len: 1323 microversion: 2.1 time: 0.107370 Jul 12 13:34:48.943469 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 314/633] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:34:48 2022] GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944 => generated 1323 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:34:49.960983 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-277f0b88-e7aa-4176-9e40-63e17911126e tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:34:49.961695 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-277f0b88-e7aa-4176-9e40-63e17911126e tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] [instance: eeb0b554-cd09-49b5-95f0-22fc7c707944] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:34:49.968017 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-277f0b88-e7aa-4176-9e40-63e17911126e tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:34:49.968637 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-277f0b88-e7aa-4176-9e40-63e17911126e tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:34:49.969630 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-277f0b88-e7aa-4176-9e40-63e17911126e tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:34:49.970307 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-277f0b88-e7aa-4176-9e40-63e17911126e tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:34:49.984280 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.wsgi [None req-277f0b88-e7aa-4176-9e40-63e17911126e tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] HTTP exception thrown: Instance eeb0b554-cd09-49b5-95f0-22fc7c707944 could not be found. Jul 12 13:34:49.986063 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-277f0b88-e7aa-4176-9e40-63e17911126e tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Request method failure captured: Jul 12 13:34:49.986063 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: request: GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944 HTTP/1.1 Jul 12 13:34:49.986063 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: Accept: application/json Jul 12 13:34:49.986063 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: Accept-Encoding: identity Jul 12 13:34:49.986063 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: Connection: close Jul 12 13:34:49.986063 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: Content-Length: 0 Jul 12 13:34:49.986063 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: Content-Type: application/json Jul 12 13:34:49.986063 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: Host: 10.222.0.23 Jul 12 13:34:49.986063 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: Openstack-System-Scope: None Jul 12 13:34:49.986063 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: User-Agent: python-urllib3/1.26.9 Jul 12 13:34:49.986063 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Auth-Token: gAAAAABizXbBhW4StkXvNG_Cn7qDisJAvAnW_dkqPglNj2mdHADqLNjh8gmpsZHQw-9lMAXOZovW8RqWJAIMoLEdIBmdJB4Oe76QieuGy8p7vooe6ChuBQBpEylWoEWoW428MD8SKwQav442J1PRNASZYWuZPdiJj8FvPuAwnE5uWyZgHi61WZg Jul 12 13:34:49.986063 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Domain-Id: None Jul 12 13:34:49.986063 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Domain-Name: None Jul 12 13:34:49.986063 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Identity-Status: Confirmed Jul 12 13:34:49.986063 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Is-Admin-Project: True Jul 12 13:34:49.986063 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Project-Domain-Id: default Jul 12 13:34:49.986063 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Project-Domain-Name: Default Jul 12 13:34:49.986063 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Project-Id: ab8fca4ab6ed466a864c5551fea5f7ff Jul 12 13:34:49.986063 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Project-Name: tempest-AttachVolumeTestJSON-593802314 Jul 12 13:34:49.986063 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Role: reader,member Jul 12 13:34:49.986063 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Roles: reader,member Jul 12 13:34:49.987683 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ab8fca4ab6ed466a864c5551fea5f7ff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ab8fca4ab6ed466a864c5551fea5f7ff", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ab8fca4ab6ed466a864c5551fea5f7ff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ab8fca4ab6ed466a864c5551fea5f7ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] Jul 12 13:34:49.987683 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Tenant: tempest-AttachVolumeTestJSON-593802314 Jul 12 13:34:49.987683 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Tenant-Id: ab8fca4ab6ed466a864c5551fea5f7ff Jul 12 13:34:49.987683 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Tenant-Name: tempest-AttachVolumeTestJSON-593802314 Jul 12 13:34:49.987683 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-User: tempest-AttachVolumeTestJSON-593802314-project Jul 12 13:34:49.987683 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-User-Domain-Id: default Jul 12 13:34:49.987683 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-User-Domain-Name: Default Jul 12 13:34:49.987683 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-User-Id: c4b710bbdf0c4d58b4f3ee7ef7410c0a Jul 12 13:34:49.987683 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-User-Name: tempest-AttachVolumeTestJSON-593802314-project Jul 12 13:34:49.987683 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: method: > Jul 12 13:34:49.987683 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: exception: Instance eeb0b554-cd09-49b5-95f0-22fc7c707944 could not be found. Jul 12 13:34:49.987683 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: action_args: {'id': 'eeb0b554-cd09-49b5-95f0-22fc7c707944'} Jul 12 13:34:49.988533 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 13:34:49.988533 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:34:49.988533 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 13:34:49.988533 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 13:34:49.988533 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 13:34:49.988533 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 13:34:49.988533 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 13:34:49.988533 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 13:34:49.988533 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 13:34:49.988533 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 13:34:49.988533 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eeb0b554-cd09-49b5-95f0-22fc7c707944 could not be found. Jul 12 13:34:49.988533 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi Jul 12 13:34:49.988533 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:34:49.988533 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi Jul 12 13:34:49.988533 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:34:49.988533 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:34:49.988533 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:34:49.988533 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 13:34:49.988533 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 13:34:49.988533 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 13:34:49.989790 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:34:49.989790 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 13:34:49.989790 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 13:34:49.989790 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 13:34:49.989790 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 13:34:49.989790 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 13:34:49.989790 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 13:34:49.989790 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eeb0b554-cd09-49b5-95f0-22fc7c707944 could not be found. Jul 12 13:34:49.989790 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi Jul 12 13:34:49.989790 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:34:49.989790 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi Jul 12 13:34:49.989790 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:34:49.989790 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:34:49.989790 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:34:49.989790 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 13:34:49.989790 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 13:34:49.989790 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eeb0b554-cd09-49b5-95f0-22fc7c707944 could not be found. Jul 12 13:34:49.989790 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi Jul 12 13:34:49.990919 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-277f0b88-e7aa-4176-9e40-63e17911126e tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Returning 404 to user: Instance eeb0b554-cd09-49b5-95f0-22fc7c707944 could not be found. {{(pid=117988) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 13:34:49.990919 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-277f0b88-e7aa-4176-9e40-63e17911126e tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] 10.222.0.23 "GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944" status: 404 len: 111 microversion: 2.1 time: 0.031394 Jul 12 13:34:49.990919 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 320/634] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:34:49 2022] GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 13:34:49.996873 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-42c221d8-cc13-4059-9fa2-48b3a065d3e7 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Calling method '.version_select at 0x7f76e90c0790>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:34:50.018791 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-42c221d8-cc13-4059-9fa2-48b3a065d3e7 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1219393667" status: 202 len: 0 microversion: 2.1 time: 0.025517 Jul 12 13:34:50.019717 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 315/635] 10.222.0.23 () {58 vars in 1220 bytes} [Tue Jul 12 13:34:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1219393667 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 13:34:50.698972 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-05d679f3-a022-42ae-acb6-7b2f28cb7afc tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Action: 'create', calling method: .version_select at 0x7f76ea11b430>, body: {"keypair": {"name": "tempest-keypair-1756865092", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO7xP+hsMIgA5LHnX1btzauKi7oyhhub/9sRSwcjE00V+4k4qJRikRitjKWasmOYnNErKtPa1eNbNKvjUqA/o2D5Q3bN6cumPLbzt5iqv2JCgDcBVfRhbjTtcGRnLruU9w=="}} {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:34:50.717641 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.quota [None req-05d679f3-a022-42ae-acb6-7b2f28cb7afc tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Getting quotas for project ab8fca4ab6ed466a864c5551fea5f7ff. Resources: {'key_pairs'} {{(pid=117988) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 13:34:50.721563 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.quota [None req-05d679f3-a022-42ae-acb6-7b2f28cb7afc tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Getting quotas for user c4b710bbdf0c4d58b4f3ee7ef7410c0a and project ab8fca4ab6ed466a864c5551fea5f7ff. Resources: {'key_pairs'} {{(pid=117988) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 13:34:50.746637 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-05d679f3-a022-42ae-acb6-7b2f28cb7afc tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.051462 Jul 12 13:34:50.747243 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 321/636] 10.222.0.23 () {60 vars in 1158 bytes} [Tue Jul 12 13:34:50 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:34:52.070950 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-8bba5448-3502-486a-85c4-e3abb9c4031d tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-679437130", "imageRef": "ce5a4b61-4265-43de-a33e-a23a4c9f612d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d6ab6b63-1bad-4bca-8802-8b8bd0c8df54"}], "security_groups": [{"name": "tempest-securitygroup--448905702"}], "key_name": "tempest-keypair-1756865092", "user_data": "}} {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:34:52.185228 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.network.neutron [None req-8bba5448-3502-486a-85c4-e3abb9c4031d tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] validate_networks() for [('d6ab6b63-1bad-4bca-8802-8b8bd0c8df54', None, None, None, None, None)] {{(pid=117987) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 13:34:52.659352 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.virt.hardware [None req-8bba5448-3502-486a-85c4-e3abb9c4031d tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Flavor limits 0:0:0 {{(pid=117987) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 13:34:52.659967 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.virt.hardware [None req-8bba5448-3502-486a-85c4-e3abb9c4031d tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Image limits 0:0:0 {{(pid=117987) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 13:34:52.660709 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.virt.hardware [None req-8bba5448-3502-486a-85c4-e3abb9c4031d tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Flavor pref 0:0:0 {{(pid=117987) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 13:34:52.661491 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.virt.hardware [None req-8bba5448-3502-486a-85c4-e3abb9c4031d tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Image pref 0:0:0 {{(pid=117987) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 13:34:52.662224 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.virt.hardware [None req-8bba5448-3502-486a-85c4-e3abb9c4031d tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117987) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 13:34:52.677233 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-8bba5448-3502-486a-85c4-e3abb9c4031d tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:34:52.677897 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-8bba5448-3502-486a-85c4-e3abb9c4031d tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:34:52.679334 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-8bba5448-3502-486a-85c4-e3abb9c4031d tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:34:52.680118 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-8bba5448-3502-486a-85c4-e3abb9c4031d tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:34:52.698577 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.quota [None req-8bba5448-3502-486a-85c4-e3abb9c4031d tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Getting quotas for project ab8fca4ab6ed466a864c5551fea5f7ff. Resources: {'ram', 'cores', 'instances'} {{(pid=117987) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 13:34:52.702660 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.quota [None req-8bba5448-3502-486a-85c4-e3abb9c4031d tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Getting quotas for user c4b710bbdf0c4d58b4f3ee7ef7410c0a and project ab8fca4ab6ed466a864c5551fea5f7ff. Resources: {'ram', 'cores', 'instances'} {{(pid=117987) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 13:34:52.713716 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-8bba5448-3502-486a-85c4-e3abb9c4031d tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Going to run 1 instances... {{(pid=117987) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 13:34:52.716006 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-8bba5448-3502-486a-85c4-e3abb9c4031d tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] [instance: a4c23b11-fc12-4dd8-8a9c-9019f9e101c9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ce5a4b61-4265-43de-a33e-a23a4c9f612d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117987) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 13:34:52.765461 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-8bba5448-3502-486a-85c4-e3abb9c4031d tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.699105 Jul 12 13:34:52.766386 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 316/637] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 12 13:34:52 2022] POST /compute/v2.1/servers => generated 401 bytes in 701 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 13:34:52.781735 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-d4f3eee8-9ea5-424a-9b45-4efb9ac7144c tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:34:52.782818 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-d4f3eee8-9ea5-424a-9b45-4efb9ac7144c tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] [instance: a4c23b11-fc12-4dd8-8a9c-9019f9e101c9] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:34:52.859711 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-d4f3eee8-9ea5-424a-9b45-4efb9ac7144c tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b710bbdf0c4d58b4f3ee7ef7410c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8fca4ab6ed466a864c5551fea5f7ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:34:52.866913 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-d4f3eee8-9ea5-424a-9b45-4efb9ac7144c tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] 10.222.0.23 "GET /compute/v2.1/servers/a4c23b11-fc12-4dd8-8a9c-9019f9e101c9" status: 200 len: 1237 microversion: 2.1 time: 0.094018 Jul 12 13:34:52.867574 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 322/638] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:34:52 2022] GET /compute/v2.1/servers/a4c23b11-fc12-4dd8-8a9c-9019f9e101c9 => generated 1237 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:34:53.886150 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-7098ede9-53e2-46b4-a9c9-28b078fc3140 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:34:53.886693 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-7098ede9-53e2-46b4-a9c9-28b078fc3140 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] [instance: a4c23b11-fc12-4dd8-8a9c-9019f9e101c9] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:34:53.895092 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-7098ede9-53e2-46b4-a9c9-28b078fc3140 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:34:53.895541 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-7098ede9-53e2-46b4-a9c9-28b078fc3140 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:34:53.896464 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-7098ede9-53e2-46b4-a9c9-28b078fc3140 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:34:53.897010 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-7098ede9-53e2-46b4-a9c9-28b078fc3140 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:34:54.208407 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-7098ede9-53e2-46b4-a9c9-28b078fc3140 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b710bbdf0c4d58b4f3ee7ef7410c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8fca4ab6ed466a864c5551fea5f7ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:34:54.216205 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-7098ede9-53e2-46b4-a9c9-28b078fc3140 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] 10.222.0.23 "GET /compute/v2.1/servers/a4c23b11-fc12-4dd8-8a9c-9019f9e101c9" status: 200 len: 1307 microversion: 2.1 time: 0.333948 Jul 12 13:34:54.216789 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 317/639] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:34:53 2022] GET /compute/v2.1/servers/a4c23b11-fc12-4dd8-8a9c-9019f9e101c9 => generated 1307 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:34:55.235902 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-e6ad1f52-5efc-47c7-8bf6-fa61fd855e7f tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:34:55.236828 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-e6ad1f52-5efc-47c7-8bf6-fa61fd855e7f tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] [instance: a4c23b11-fc12-4dd8-8a9c-9019f9e101c9] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:34:55.249127 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-e6ad1f52-5efc-47c7-8bf6-fa61fd855e7f tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:34:55.249719 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-e6ad1f52-5efc-47c7-8bf6-fa61fd855e7f tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:34:55.250601 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-e6ad1f52-5efc-47c7-8bf6-fa61fd855e7f tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:34:55.251035 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-e6ad1f52-5efc-47c7-8bf6-fa61fd855e7f tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:34:55.403759 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-e6ad1f52-5efc-47c7-8bf6-fa61fd855e7f tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b710bbdf0c4d58b4f3ee7ef7410c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8fca4ab6ed466a864c5551fea5f7ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:34:55.412396 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-e6ad1f52-5efc-47c7-8bf6-fa61fd855e7f tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] 10.222.0.23 "GET /compute/v2.1/servers/a4c23b11-fc12-4dd8-8a9c-9019f9e101c9" status: 200 len: 1362 microversion: 2.1 time: 0.180469 Jul 12 13:34:55.412975 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 323/640] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:34:55 2022] GET /compute/v2.1/servers/a4c23b11-fc12-4dd8-8a9c-9019f9e101c9 => generated 1362 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:34:55.740391 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [req-de745576-842e-4e57-a129-6e84fb29b68d req-b6f8a5cf-ddc9-4995-8bdc-56b7c1b15faf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4c23b11-fc12-4dd8-8a9c-9019f9e101c9", "tag": "db6b5192-4809-4713-81d9-1ab933f58c63"}]} {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:34:55.750603 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [req-de745576-842e-4e57-a129-6e84fb29b68d req-b6f8a5cf-ddc9-4995-8bdc-56b7c1b15faf service nova] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:34:55.751151 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [req-de745576-842e-4e57-a129-6e84fb29b68d req-b6f8a5cf-ddc9-4995-8bdc-56b7c1b15faf service nova] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:34:55.774590 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.compute.server_external_events [req-de745576-842e-4e57-a129-6e84fb29b68d req-b6f8a5cf-ddc9-4995-8bdc-56b7c1b15faf service nova] Creating event network-changed:db6b5192-4809-4713-81d9-1ab933f58c63 for instance a4c23b11-fc12-4dd8-8a9c-9019f9e101c9 on hv-cinder-82002 Jul 12 13:34:55.791073 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [req-de745576-842e-4e57-a129-6e84fb29b68d req-b6f8a5cf-ddc9-4995-8bdc-56b7c1b15faf service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057568 Jul 12 13:34:55.792758 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 318/641] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 12 13:34:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:34:56.430266 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-90063abd-66c5-4f50-8579-b1f1927b2f80 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:34:56.430875 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-90063abd-66c5-4f50-8579-b1f1927b2f80 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] [instance: a4c23b11-fc12-4dd8-8a9c-9019f9e101c9] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:34:56.438372 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-90063abd-66c5-4f50-8579-b1f1927b2f80 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:34:56.438846 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-90063abd-66c5-4f50-8579-b1f1927b2f80 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:34:56.439610 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-90063abd-66c5-4f50-8579-b1f1927b2f80 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:34:56.440039 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-90063abd-66c5-4f50-8579-b1f1927b2f80 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:34:56.575373 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-90063abd-66c5-4f50-8579-b1f1927b2f80 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b710bbdf0c4d58b4f3ee7ef7410c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8fca4ab6ed466a864c5551fea5f7ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:34:56.584549 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-90063abd-66c5-4f50-8579-b1f1927b2f80 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] 10.222.0.23 "GET /compute/v2.1/servers/a4c23b11-fc12-4dd8-8a9c-9019f9e101c9" status: 200 len: 1362 microversion: 2.1 time: 0.158138 Jul 12 13:34:56.585119 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 324/642] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:34:56 2022] GET /compute/v2.1/servers/a4c23b11-fc12-4dd8-8a9c-9019f9e101c9 => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:34:57.602539 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-cd2f949f-6118-43e8-92f6-9a96d9221a49 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:34:57.603141 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-cd2f949f-6118-43e8-92f6-9a96d9221a49 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] [instance: a4c23b11-fc12-4dd8-8a9c-9019f9e101c9] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:34:57.610190 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-cd2f949f-6118-43e8-92f6-9a96d9221a49 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:34:57.610626 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-cd2f949f-6118-43e8-92f6-9a96d9221a49 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:34:57.611904 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-cd2f949f-6118-43e8-92f6-9a96d9221a49 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:34:57.612331 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-cd2f949f-6118-43e8-92f6-9a96d9221a49 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:34:57.745796 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-cd2f949f-6118-43e8-92f6-9a96d9221a49 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b710bbdf0c4d58b4f3ee7ef7410c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8fca4ab6ed466a864c5551fea5f7ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:34:57.753357 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-cd2f949f-6118-43e8-92f6-9a96d9221a49 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] 10.222.0.23 "GET /compute/v2.1/servers/a4c23b11-fc12-4dd8-8a9c-9019f9e101c9" status: 200 len: 1362 microversion: 2.1 time: 0.154982 Jul 12 13:34:57.753956 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 319/643] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:34:57 2022] GET /compute/v2.1/servers/a4c23b11-fc12-4dd8-8a9c-9019f9e101c9 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:34:58.770180 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-94f9caf0-deca-4531-bc79-48600cd2e04e tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:34:58.770890 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-94f9caf0-deca-4531-bc79-48600cd2e04e tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] [instance: a4c23b11-fc12-4dd8-8a9c-9019f9e101c9] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:34:58.777679 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-94f9caf0-deca-4531-bc79-48600cd2e04e tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:34:58.778126 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-94f9caf0-deca-4531-bc79-48600cd2e04e tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:34:58.778889 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-94f9caf0-deca-4531-bc79-48600cd2e04e tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:34:58.779325 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-94f9caf0-deca-4531-bc79-48600cd2e04e tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:34:58.924812 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-94f9caf0-deca-4531-bc79-48600cd2e04e tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b710bbdf0c4d58b4f3ee7ef7410c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8fca4ab6ed466a864c5551fea5f7ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:34:58.937269 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-94f9caf0-deca-4531-bc79-48600cd2e04e tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] 10.222.0.23 "GET /compute/v2.1/servers/a4c23b11-fc12-4dd8-8a9c-9019f9e101c9" status: 200 len: 1362 microversion: 2.1 time: 0.170783 Jul 12 13:34:58.938609 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 325/644] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:34:58 2022] GET /compute/v2.1/servers/a4c23b11-fc12-4dd8-8a9c-9019f9e101c9 => generated 1362 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:34:59.961515 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-8eb228c2-2978-47f6-be42-1cf2968baa33 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:34:59.962186 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-8eb228c2-2978-47f6-be42-1cf2968baa33 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] [instance: a4c23b11-fc12-4dd8-8a9c-9019f9e101c9] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:34:59.969188 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-8eb228c2-2978-47f6-be42-1cf2968baa33 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:34:59.969768 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-8eb228c2-2978-47f6-be42-1cf2968baa33 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:34:59.970561 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-8eb228c2-2978-47f6-be42-1cf2968baa33 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:34:59.970996 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-8eb228c2-2978-47f6-be42-1cf2968baa33 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:35:00.120683 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-8eb228c2-2978-47f6-be42-1cf2968baa33 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b710bbdf0c4d58b4f3ee7ef7410c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8fca4ab6ed466a864c5551fea5f7ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:35:00.129660 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-8eb228c2-2978-47f6-be42-1cf2968baa33 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] 10.222.0.23 "GET /compute/v2.1/servers/a4c23b11-fc12-4dd8-8a9c-9019f9e101c9" status: 200 len: 1362 microversion: 2.1 time: 0.171877 Jul 12 13:35:00.130258 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 320/645] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:34:59 2022] GET /compute/v2.1/servers/a4c23b11-fc12-4dd8-8a9c-9019f9e101c9 => generated 1362 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:35:01.147369 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-7c7ba06c-60cb-47f0-aa65-bd21027b6c38 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:35:01.147976 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-7c7ba06c-60cb-47f0-aa65-bd21027b6c38 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] [instance: a4c23b11-fc12-4dd8-8a9c-9019f9e101c9] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:35:01.154544 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-7c7ba06c-60cb-47f0-aa65-bd21027b6c38 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:35:01.154993 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-7c7ba06c-60cb-47f0-aa65-bd21027b6c38 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:35:01.155754 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-7c7ba06c-60cb-47f0-aa65-bd21027b6c38 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:35:01.156768 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-7c7ba06c-60cb-47f0-aa65-bd21027b6c38 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:35:01.292270 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-7c7ba06c-60cb-47f0-aa65-bd21027b6c38 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b710bbdf0c4d58b4f3ee7ef7410c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8fca4ab6ed466a864c5551fea5f7ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:35:01.299909 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-7c7ba06c-60cb-47f0-aa65-bd21027b6c38 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] 10.222.0.23 "GET /compute/v2.1/servers/a4c23b11-fc12-4dd8-8a9c-9019f9e101c9" status: 200 len: 1362 microversion: 2.1 time: 0.156352 Jul 12 13:35:01.300489 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 326/646] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:35:01 2022] GET /compute/v2.1/servers/a4c23b11-fc12-4dd8-8a9c-9019f9e101c9 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:35:01.545602 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [req-bf344aa1-5134-4559-9119-47d1421691c0 req-f10e2c23-b634-4227-bee5-7fa794b0b811 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4c23b11-fc12-4dd8-8a9c-9019f9e101c9", "name": "network-vif-plugged", "status": "completed", "tag": "db6b5192-4809-4713-81d9-1ab933f58c63"}]} {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:35:01.555702 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [req-bf344aa1-5134-4559-9119-47d1421691c0 req-f10e2c23-b634-4227-bee5-7fa794b0b811 service nova] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:35:01.556149 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [req-bf344aa1-5134-4559-9119-47d1421691c0 req-f10e2c23-b634-4227-bee5-7fa794b0b811 service nova] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:35:01.572397 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.compute.server_external_events [req-bf344aa1-5134-4559-9119-47d1421691c0 req-f10e2c23-b634-4227-bee5-7fa794b0b811 service nova] Creating event network-vif-plugged:db6b5192-4809-4713-81d9-1ab933f58c63 for instance a4c23b11-fc12-4dd8-8a9c-9019f9e101c9 on hv-cinder-82002 Jul 12 13:35:01.577250 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [req-bf344aa1-5134-4559-9119-47d1421691c0 req-f10e2c23-b634-4227-bee5-7fa794b0b811 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035522 Jul 12 13:35:01.577889 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 321/647] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 12 13:35:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 13:35:02.317903 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-44475cf7-f2ed-47b5-bad8-b4360b67f24d tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:35:02.318846 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-44475cf7-f2ed-47b5-bad8-b4360b67f24d tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] [instance: a4c23b11-fc12-4dd8-8a9c-9019f9e101c9] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:35:02.326632 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-44475cf7-f2ed-47b5-bad8-b4360b67f24d tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:35:02.327081 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-44475cf7-f2ed-47b5-bad8-b4360b67f24d tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:35:02.327883 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-44475cf7-f2ed-47b5-bad8-b4360b67f24d tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:35:02.328316 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-44475cf7-f2ed-47b5-bad8-b4360b67f24d tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:35:02.466247 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-44475cf7-f2ed-47b5-bad8-b4360b67f24d tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b710bbdf0c4d58b4f3ee7ef7410c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8fca4ab6ed466a864c5551fea5f7ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:35:02.474930 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-44475cf7-f2ed-47b5-bad8-b4360b67f24d tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] 10.222.0.23 "GET /compute/v2.1/servers/a4c23b11-fc12-4dd8-8a9c-9019f9e101c9" status: 200 len: 1362 microversion: 2.1 time: 0.162650 Jul 12 13:35:02.475514 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 327/648] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:35:02 2022] GET /compute/v2.1/servers/a4c23b11-fc12-4dd8-8a9c-9019f9e101c9 => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:35:03.490453 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG dbcounter [-] [117987] Writing DB stats nova_cell0:SELECT=2 {{(pid=117987) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:35:03.491461 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG dbcounter [-] [117987] Writing DB stats nova_cell0:SELECT=6 {{(pid=117987) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:35:03.497111 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-87cbea6b-c7bb-42c3-b167-4a09cedd1211 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:35:03.497843 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-87cbea6b-c7bb-42c3-b167-4a09cedd1211 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] [instance: a4c23b11-fc12-4dd8-8a9c-9019f9e101c9] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:35:03.505915 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-87cbea6b-c7bb-42c3-b167-4a09cedd1211 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:35:03.506290 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-87cbea6b-c7bb-42c3-b167-4a09cedd1211 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:35:03.507090 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-87cbea6b-c7bb-42c3-b167-4a09cedd1211 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:35:03.507522 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-87cbea6b-c7bb-42c3-b167-4a09cedd1211 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:35:03.648682 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-87cbea6b-c7bb-42c3-b167-4a09cedd1211 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b710bbdf0c4d58b4f3ee7ef7410c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8fca4ab6ed466a864c5551fea5f7ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:35:03.656912 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-87cbea6b-c7bb-42c3-b167-4a09cedd1211 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] 10.222.0.23 "GET /compute/v2.1/servers/a4c23b11-fc12-4dd8-8a9c-9019f9e101c9" status: 200 len: 1548 microversion: 2.1 time: 0.167968 Jul 12 13:35:03.657523 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 322/649] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:35:03 2022] GET /compute/v2.1/servers/a4c23b11-fc12-4dd8-8a9c-9019f9e101c9 => generated 1548 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:35:03.674224 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-765b2cd9-636c-4bc3-8a19-807fd8111e30 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:35:03.674760 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-765b2cd9-636c-4bc3-8a19-807fd8111e30 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] [instance: a4c23b11-fc12-4dd8-8a9c-9019f9e101c9] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:35:03.676653 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG dbcounter [-] [117988] Writing DB stats nova_cell0:SELECT=6 {{(pid=117988) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:35:03.682579 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-765b2cd9-636c-4bc3-8a19-807fd8111e30 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:35:03.683026 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-765b2cd9-636c-4bc3-8a19-807fd8111e30 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:35:03.683786 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-765b2cd9-636c-4bc3-8a19-807fd8111e30 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:35:03.684214 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-765b2cd9-636c-4bc3-8a19-807fd8111e30 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:35:03.766451 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-765b2cd9-636c-4bc3-8a19-807fd8111e30 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] 10.222.0.23 "GET /compute/v2.1/servers/a4c23b11-fc12-4dd8-8a9c-9019f9e101c9/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096601 Jul 12 13:35:03.767177 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 328/650] 10.222.0.23 () {58 vars in 1274 bytes} [Tue Jul 12 13:35:03 2022] GET /compute/v2.1/servers/a4c23b11-fc12-4dd8-8a9c-9019f9e101c9/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:35:04.770037 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [req-1bfdd645-f823-4dff-b220-57381c1e0104 req-9ff4acef-8cd7-4fcc-a1e6-30eb6da50c3c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4c23b11-fc12-4dd8-8a9c-9019f9e101c9", "tag": "db6b5192-4809-4713-81d9-1ab933f58c63"}]} {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:35:04.778755 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [req-1bfdd645-f823-4dff-b220-57381c1e0104 req-9ff4acef-8cd7-4fcc-a1e6-30eb6da50c3c service nova] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:35:04.779200 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [req-1bfdd645-f823-4dff-b220-57381c1e0104 req-9ff4acef-8cd7-4fcc-a1e6-30eb6da50c3c service nova] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:35:04.790699 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.compute.server_external_events [req-1bfdd645-f823-4dff-b220-57381c1e0104 req-9ff4acef-8cd7-4fcc-a1e6-30eb6da50c3c service nova] Creating event network-changed:db6b5192-4809-4713-81d9-1ab933f58c63 for instance a4c23b11-fc12-4dd8-8a9c-9019f9e101c9 on hv-cinder-82002 Jul 12 13:35:04.795518 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [req-1bfdd645-f823-4dff-b220-57381c1e0104 req-9ff4acef-8cd7-4fcc-a1e6-30eb6da50c3c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029193 Jul 12 13:35:04.797061 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 323/651] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 12 13:35:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:35:06.987076 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-a4cb7574-238e-41a6-8d15-f46210e09438 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:35:06.987612 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-a4cb7574-238e-41a6-8d15-f46210e09438 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: 5982cf25-982e-4787-8992-63184a0dd50f] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:35:06.993616 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-a4cb7574-238e-41a6-8d15-f46210e09438 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:35:06.994059 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-a4cb7574-238e-41a6-8d15-f46210e09438 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:35:06.994813 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-a4cb7574-238e-41a6-8d15-f46210e09438 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:35:06.995241 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-a4cb7574-238e-41a6-8d15-f46210e09438 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:35:07.087520 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.objects.instance [None req-a4cb7574-238e-41a6-8d15-f46210e09438 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lazy-loading 'services' on Instance uuid 5982cf25-982e-4787-8992-63184a0dd50f {{(pid=117988) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 13:35:07.157967 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-a4cb7574-238e-41a6-8d15-f46210e09438 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "DELETE /compute/v2.1/servers/5982cf25-982e-4787-8992-63184a0dd50f/os-volume_attachments/d5f4335b-7712-4da4-ab0f-002f9fff8c1e" status: 202 len: 0 microversion: 2.1 time: 0.175858 Jul 12 13:35:07.158603 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 329/652] 10.222.0.23 () {58 vars in 1415 bytes} [Tue Jul 12 13:35:06 2022] DELETE /compute/v2.1/servers/5982cf25-982e-4787-8992-63184a0dd50f/os-volume_attachments/d5f4335b-7712-4da4-ab0f-002f9fff8c1e => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 13:35:07.168128 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-ff53368f-e988-4b71-87cc-deb58e41b99e tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:35:07.169194 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-ff53368f-e988-4b71-87cc-deb58e41b99e tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: 5982cf25-982e-4787-8992-63184a0dd50f] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:35:07.176436 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-ff53368f-e988-4b71-87cc-deb58e41b99e tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:35:07.177049 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-ff53368f-e988-4b71-87cc-deb58e41b99e tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:35:07.178052 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-ff53368f-e988-4b71-87cc-deb58e41b99e tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:35:07.178490 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-ff53368f-e988-4b71-87cc-deb58e41b99e tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:35:07.208219 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-ff53368f-e988-4b71-87cc-deb58e41b99e tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "GET /compute/v2.1/servers/5982cf25-982e-4787-8992-63184a0dd50f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044676 Jul 12 13:35:07.208679 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 324/653] 10.222.0.23 () {58 vars in 1301 bytes} [Tue Jul 12 13:35:07 2022] GET /compute/v2.1/servers/5982cf25-982e-4787-8992-63184a0dd50f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:35:08.223850 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-ed6f9347-d8f9-4a48-8399-2deb628c7673 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:35:08.225637 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-ed6f9347-d8f9-4a48-8399-2deb628c7673 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: 5982cf25-982e-4787-8992-63184a0dd50f] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:35:08.232843 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-ed6f9347-d8f9-4a48-8399-2deb628c7673 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:35:08.233597 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-ed6f9347-d8f9-4a48-8399-2deb628c7673 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:35:08.235132 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-ed6f9347-d8f9-4a48-8399-2deb628c7673 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:35:08.235578 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-ed6f9347-d8f9-4a48-8399-2deb628c7673 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:35:08.266603 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-ed6f9347-d8f9-4a48-8399-2deb628c7673 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "GET /compute/v2.1/servers/5982cf25-982e-4787-8992-63184a0dd50f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048105 Jul 12 13:35:08.267253 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 330/654] 10.222.0.23 () {58 vars in 1301 bytes} [Tue Jul 12 13:35:08 2022] GET /compute/v2.1/servers/5982cf25-982e-4787-8992-63184a0dd50f/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 12 13:35:08.344213 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-e825dc09-c165-4a4f-af9f-cd38ad718b8f tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:35:08.344912 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-e825dc09-c165-4a4f-af9f-cd38ad718b8f tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: 5982cf25-982e-4787-8992-63184a0dd50f] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:35:08.351231 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-e825dc09-c165-4a4f-af9f-cd38ad718b8f tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:35:08.351670 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-e825dc09-c165-4a4f-af9f-cd38ad718b8f tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:35:08.352455 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-e825dc09-c165-4a4f-af9f-cd38ad718b8f tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:35:08.352882 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-e825dc09-c165-4a4f-af9f-cd38ad718b8f tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:35:08.377617 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-e825dc09-c165-4a4f-af9f-cd38ad718b8f tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: 5982cf25-982e-4787-8992-63184a0dd50f] Going to try to terminate instance {{(pid=117987) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 13:35:08.453706 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-e825dc09-c165-4a4f-af9f-cd38ad718b8f tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "DELETE /compute/v2.1/servers/5982cf25-982e-4787-8992-63184a0dd50f" status: 204 len: 0 microversion: 2.1 time: 0.113050 Jul 12 13:35:08.454217 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 325/655] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 12 13:35:08 2022] DELETE /compute/v2.1/servers/5982cf25-982e-4787-8992-63184a0dd50f => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 13:35:08.462126 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-66551430-0d81-4838-ba96-34641cc02958 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:35:08.462728 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-66551430-0d81-4838-ba96-34641cc02958 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: 5982cf25-982e-4787-8992-63184a0dd50f] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:35:08.469345 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-66551430-0d81-4838-ba96-34641cc02958 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:35:08.469998 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-66551430-0d81-4838-ba96-34641cc02958 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:35:08.470560 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-66551430-0d81-4838-ba96-34641cc02958 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:35:08.470990 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-66551430-0d81-4838-ba96-34641cc02958 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:35:08.611731 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-66551430-0d81-4838-ba96-34641cc02958 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f448776d1074e22bfe6cfbe05e01db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27fe465e6743e19feec424e6e9f3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:35:08.619358 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-66551430-0d81-4838-ba96-34641cc02958 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "GET /compute/v2.1/servers/5982cf25-982e-4787-8992-63184a0dd50f" status: 200 len: 1691 microversion: 2.1 time: 0.161029 Jul 12 13:35:08.619940 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 331/656] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:35:08 2022] GET /compute/v2.1/servers/5982cf25-982e-4787-8992-63184a0dd50f => generated 1691 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:35:09.636665 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-50576cc2-2fc3-4e3e-8454-89d7dcf78999 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:35:09.637282 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-50576cc2-2fc3-4e3e-8454-89d7dcf78999 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: 5982cf25-982e-4787-8992-63184a0dd50f] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:35:09.644573 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-50576cc2-2fc3-4e3e-8454-89d7dcf78999 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:35:09.645019 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-50576cc2-2fc3-4e3e-8454-89d7dcf78999 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:35:09.645806 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-50576cc2-2fc3-4e3e-8454-89d7dcf78999 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:35:09.646238 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-50576cc2-2fc3-4e3e-8454-89d7dcf78999 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:35:09.790944 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-50576cc2-2fc3-4e3e-8454-89d7dcf78999 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f448776d1074e22bfe6cfbe05e01db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27fe465e6743e19feec424e6e9f3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:35:09.799733 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-50576cc2-2fc3-4e3e-8454-89d7dcf78999 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "GET /compute/v2.1/servers/5982cf25-982e-4787-8992-63184a0dd50f" status: 200 len: 1691 microversion: 2.1 time: 0.167268 Jul 12 13:35:09.800603 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 326/657] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:35:09 2022] GET /compute/v2.1/servers/5982cf25-982e-4787-8992-63184a0dd50f => generated 1691 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:35:10.818379 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-a3eb5829-075c-4c9a-ad92-1c645f7160ca tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:35:10.818935 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-a3eb5829-075c-4c9a-ad92-1c645f7160ca tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: 5982cf25-982e-4787-8992-63184a0dd50f] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:35:10.825587 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-a3eb5829-075c-4c9a-ad92-1c645f7160ca tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:35:10.826042 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-a3eb5829-075c-4c9a-ad92-1c645f7160ca tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:35:10.826810 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-a3eb5829-075c-4c9a-ad92-1c645f7160ca tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:35:10.827247 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-a3eb5829-075c-4c9a-ad92-1c645f7160ca tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:35:10.960017 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-a3eb5829-075c-4c9a-ad92-1c645f7160ca tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f448776d1074e22bfe6cfbe05e01db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27fe465e6743e19feec424e6e9f3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:35:10.967427 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-a3eb5829-075c-4c9a-ad92-1c645f7160ca tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "GET /compute/v2.1/servers/5982cf25-982e-4787-8992-63184a0dd50f" status: 200 len: 1691 microversion: 2.1 time: 0.153213 Jul 12 13:35:10.967998 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 332/658] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:35:10 2022] GET /compute/v2.1/servers/5982cf25-982e-4787-8992-63184a0dd50f => generated 1691 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:35:11.985728 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-4d21c3a0-6e26-4fbb-8201-6eeba1d8f55f tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:35:11.986374 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-4d21c3a0-6e26-4fbb-8201-6eeba1d8f55f tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: 5982cf25-982e-4787-8992-63184a0dd50f] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:35:11.992966 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-4d21c3a0-6e26-4fbb-8201-6eeba1d8f55f tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:35:11.993434 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-4d21c3a0-6e26-4fbb-8201-6eeba1d8f55f tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:35:11.994201 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-4d21c3a0-6e26-4fbb-8201-6eeba1d8f55f tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:35:11.994631 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-4d21c3a0-6e26-4fbb-8201-6eeba1d8f55f tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:35:12.137626 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-4d21c3a0-6e26-4fbb-8201-6eeba1d8f55f tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f448776d1074e22bfe6cfbe05e01db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27fe465e6743e19feec424e6e9f3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:35:12.147559 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-4d21c3a0-6e26-4fbb-8201-6eeba1d8f55f tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "GET /compute/v2.1/servers/5982cf25-982e-4787-8992-63184a0dd50f" status: 200 len: 1691 microversion: 2.1 time: 0.166461 Jul 12 13:35:12.148150 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 327/659] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:35:11 2022] GET /compute/v2.1/servers/5982cf25-982e-4787-8992-63184a0dd50f => generated 1691 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:35:13.155647 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [req-88674c0f-7fed-4f49-9029-a52fe6e4c815 req-752632ba-3936-4d1a-9f50-4f290c0f3aa8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5982cf25-982e-4787-8992-63184a0dd50f", "name": "network-vif-deleted", "tag": "48ee5689-784c-4392-88f9-2238b2c24ca3"}]} {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:35:13.166059 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [req-88674c0f-7fed-4f49-9029-a52fe6e4c815 req-752632ba-3936-4d1a-9f50-4f290c0f3aa8 service nova] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:35:13.166347 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-5f9dcec9-7512-4e4a-843c-dc5bb6736373 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:35:13.167024 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-5f9dcec9-7512-4e4a-843c-dc5bb6736373 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: 5982cf25-982e-4787-8992-63184a0dd50f] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:35:13.167346 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [req-88674c0f-7fed-4f49-9029-a52fe6e4c815 req-752632ba-3936-4d1a-9f50-4f290c0f3aa8 service nova] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:35:13.174929 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-5f9dcec9-7512-4e4a-843c-dc5bb6736373 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:35:13.175386 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-5f9dcec9-7512-4e4a-843c-dc5bb6736373 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:35:13.176188 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-5f9dcec9-7512-4e4a-843c-dc5bb6736373 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:35:13.176585 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-5f9dcec9-7512-4e4a-843c-dc5bb6736373 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:35:13.181078 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.compute.server_external_events [req-88674c0f-7fed-4f49-9029-a52fe6e4c815 req-752632ba-3936-4d1a-9f50-4f290c0f3aa8 service nova] Creating event network-vif-deleted:48ee5689-784c-4392-88f9-2238b2c24ca3 for instance 5982cf25-982e-4787-8992-63184a0dd50f on hv-cinder-82002 Jul 12 13:35:13.188158 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [req-88674c0f-7fed-4f49-9029-a52fe6e4c815 req-752632ba-3936-4d1a-9f50-4f290c0f3aa8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035871 Jul 12 13:35:13.189349 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 333/660] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 12 13:35:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:35:13.258582 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-5f9dcec9-7512-4e4a-843c-dc5bb6736373 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f448776d1074e22bfe6cfbe05e01db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27fe465e6743e19feec424e6e9f3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:35:13.267648 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-5f9dcec9-7512-4e4a-843c-dc5bb6736373 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "GET /compute/v2.1/servers/5982cf25-982e-4787-8992-63184a0dd50f" status: 200 len: 1623 microversion: 2.1 time: 0.105535 Jul 12 13:35:13.268377 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 328/661] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:35:13 2022] GET /compute/v2.1/servers/5982cf25-982e-4787-8992-63184a0dd50f => generated 1623 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:35:14.286683 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-aec39719-4cce-4185-ad3c-a21aeefadc03 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:35:14.287470 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-aec39719-4cce-4185-ad3c-a21aeefadc03 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: 5982cf25-982e-4787-8992-63184a0dd50f] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:35:14.294254 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-aec39719-4cce-4185-ad3c-a21aeefadc03 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:35:14.294701 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-aec39719-4cce-4185-ad3c-a21aeefadc03 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:35:14.295600 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-aec39719-4cce-4185-ad3c-a21aeefadc03 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:35:14.296041 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-aec39719-4cce-4185-ad3c-a21aeefadc03 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:35:14.311604 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.wsgi [None req-aec39719-4cce-4185-ad3c-a21aeefadc03 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] HTTP exception thrown: Instance 5982cf25-982e-4787-8992-63184a0dd50f could not be found. Jul 12 13:35:14.314055 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-aec39719-4cce-4185-ad3c-a21aeefadc03 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Request method failure captured: Jul 12 13:35:14.314055 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: request: GET /compute/v2.1/servers/5982cf25-982e-4787-8992-63184a0dd50f HTTP/1.1 Jul 12 13:35:14.314055 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: Accept: application/json Jul 12 13:35:14.314055 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: Accept-Encoding: identity Jul 12 13:35:14.314055 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: Connection: close Jul 12 13:35:14.314055 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: Content-Length: 0 Jul 12 13:35:14.314055 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: Content-Type: application/json Jul 12 13:35:14.314055 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: Host: 10.222.0.23 Jul 12 13:35:14.314055 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: Openstack-System-Scope: None Jul 12 13:35:14.314055 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: User-Agent: python-urllib3/1.26.9 Jul 12 13:35:14.314055 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Auth-Token: gAAAAABizXbHaqiAqZhWBI-vk_o7a-bGHsret_K3_OESrsSqXK-GPMz9bPJQcG7LrA86KpPc4AMrjwGTn_JiGdYdVtYddlqLRSDG3IHGj5eQPo9N843Dt2ruWjpHNFsSPymDgsCEgYLfMLp_zHvOn_zPoeXgUvrsNthFZ_9cbS3sn5NZOuhEk88 Jul 12 13:35:14.314055 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Domain-Id: None Jul 12 13:35:14.314055 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Domain-Name: None Jul 12 13:35:14.314055 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Identity-Status: Confirmed Jul 12 13:35:14.314055 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Is-Admin-Project: True Jul 12 13:35:14.314055 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Project-Domain-Id: default Jul 12 13:35:14.314055 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Project-Domain-Name: Default Jul 12 13:35:14.314055 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Project-Id: 2c27fe465e6743e19feec424e6e9f3d1 Jul 12 13:35:14.314055 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-115734551 Jul 12 13:35:14.314055 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Role: reader,member Jul 12 13:35:14.314055 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Roles: reader,member Jul 12 13:35:14.315587 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2c27fe465e6743e19feec424e6e9f3d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2c27fe465e6743e19feec424e6e9f3d1", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2c27fe465e6743e19feec424e6e9f3d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2c27fe465e6743e19feec424e6e9f3d1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] Jul 12 13:35:14.315587 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Tenant: tempest-ServerRescueNegativeTestJSON-115734551 Jul 12 13:35:14.315587 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Tenant-Id: 2c27fe465e6743e19feec424e6e9f3d1 Jul 12 13:35:14.315587 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-115734551 Jul 12 13:35:14.315587 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-User: tempest-ServerRescueNegativeTestJSON-115734551-project Jul 12 13:35:14.315587 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-User-Domain-Id: default Jul 12 13:35:14.315587 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-User-Domain-Name: Default Jul 12 13:35:14.315587 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-User-Id: 8f448776d1074e22bfe6cfbe05e01db7 Jul 12 13:35:14.315587 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-User-Name: tempest-ServerRescueNegativeTestJSON-115734551-project Jul 12 13:35:14.315587 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: method: > Jul 12 13:35:14.315587 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: exception: Instance 5982cf25-982e-4787-8992-63184a0dd50f could not be found. Jul 12 13:35:14.315587 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: action_args: {'id': '5982cf25-982e-4787-8992-63184a0dd50f'} Jul 12 13:35:14.316320 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 13:35:14.316320 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:35:14.316320 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 13:35:14.316320 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 13:35:14.316320 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 13:35:14.316320 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 13:35:14.316320 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 13:35:14.316320 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 13:35:14.316320 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 13:35:14.316320 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 13:35:14.316320 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5982cf25-982e-4787-8992-63184a0dd50f could not be found. Jul 12 13:35:14.316320 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi Jul 12 13:35:14.316320 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:35:14.316320 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi Jul 12 13:35:14.316320 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:35:14.316320 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:35:14.316320 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:35:14.316320 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 13:35:14.316320 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 13:35:14.316320 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 13:35:14.317907 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:35:14.317907 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 13:35:14.317907 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 13:35:14.317907 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 13:35:14.317907 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 13:35:14.317907 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 13:35:14.317907 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 13:35:14.317907 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5982cf25-982e-4787-8992-63184a0dd50f could not be found. Jul 12 13:35:14.317907 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi Jul 12 13:35:14.317907 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:35:14.317907 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi Jul 12 13:35:14.317907 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:35:14.317907 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:35:14.317907 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:35:14.317907 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 13:35:14.317907 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 13:35:14.317907 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5982cf25-982e-4787-8992-63184a0dd50f could not be found. Jul 12 13:35:14.317907 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi Jul 12 13:35:14.319080 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-aec39719-4cce-4185-ad3c-a21aeefadc03 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Returning 404 to user: Instance 5982cf25-982e-4787-8992-63184a0dd50f could not be found. {{(pid=117988) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 13:35:14.319080 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-aec39719-4cce-4185-ad3c-a21aeefadc03 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "GET /compute/v2.1/servers/5982cf25-982e-4787-8992-63184a0dd50f" status: 404 len: 111 microversion: 2.1 time: 0.034698 Jul 12 13:35:14.319080 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 334/662] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:35:14 2022] GET /compute/v2.1/servers/5982cf25-982e-4787-8992-63184a0dd50f => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 12 13:35:14.325866 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-5c43cde8-c1e4-45c9-91f8-5fe958267cf3 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Calling method '.version_select at 0x7f76e929a5e0>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:35:14.345328 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-5c43cde8-c1e4-45c9-91f8-5fe958267cf3 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1460597857" status: 202 len: 0 microversion: 2.1 time: 0.023145 Jul 12 13:35:14.346592 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 329/663] 10.222.0.23 () {58 vars in 1220 bytes} [Tue Jul 12 13:35:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1460597857 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 12 13:35:17.232828 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-a1717995-af79-4d8b-b05b-da1a1233f8dd tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:35:17.233357 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-a1717995-af79-4d8b-b05b-da1a1233f8dd tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: 95edada5-d3ec-4056-99e9-379fb4b65394] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:35:17.236618 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG dbcounter [-] [117988] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=1 {{(pid=117988) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:35:17.242095 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-a1717995-af79-4d8b-b05b-da1a1233f8dd tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:35:17.242539 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-a1717995-af79-4d8b-b05b-da1a1233f8dd tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:35:17.243322 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-a1717995-af79-4d8b-b05b-da1a1233f8dd tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:35:17.243766 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-a1717995-af79-4d8b-b05b-da1a1233f8dd tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:35:17.247625 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG dbcounter [-] [117988] Writing DB stats nova_cell1:SELECT=82,nova_cell1:INSERT=1 {{(pid=117988) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:35:17.273595 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-a1717995-af79-4d8b-b05b-da1a1233f8dd tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: 95edada5-d3ec-4056-99e9-379fb4b65394] Going to try to terminate instance {{(pid=117988) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 13:35:17.363133 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-a1717995-af79-4d8b-b05b-da1a1233f8dd tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "DELETE /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394" status: 204 len: 0 microversion: 2.1 time: 0.133144 Jul 12 13:35:17.363765 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 335/664] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 12 13:35:17 2022] DELETE /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 13:35:17.373062 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-512801c0-1200-4204-8707-8daa6030afb0 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:35:17.373709 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-512801c0-1200-4204-8707-8daa6030afb0 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: 95edada5-d3ec-4056-99e9-379fb4b65394] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:35:17.375803 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG dbcounter [-] [117987] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=2,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=117987) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:35:17.384153 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-512801c0-1200-4204-8707-8daa6030afb0 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:35:17.384603 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-512801c0-1200-4204-8707-8daa6030afb0 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:35:17.385393 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-512801c0-1200-4204-8707-8daa6030afb0 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:35:17.387360 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-512801c0-1200-4204-8707-8daa6030afb0 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:35:17.392995 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG dbcounter [-] [117987] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117987) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:35:17.555492 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-512801c0-1200-4204-8707-8daa6030afb0 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f448776d1074e22bfe6cfbe05e01db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27fe465e6743e19feec424e6e9f3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:35:17.564060 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-512801c0-1200-4204-8707-8daa6030afb0 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394" status: 200 len: 1507 microversion: 2.1 time: 0.195194 Jul 12 13:35:17.564653 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 330/665] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:35:17 2022] GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394 => generated 1507 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:35:18.587426 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-b1ef70de-6671-4e95-8e2d-81c1a2474a68 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:35:18.588420 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-b1ef70de-6671-4e95-8e2d-81c1a2474a68 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: 95edada5-d3ec-4056-99e9-379fb4b65394] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:35:18.595511 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-b1ef70de-6671-4e95-8e2d-81c1a2474a68 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:35:18.597008 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-b1ef70de-6671-4e95-8e2d-81c1a2474a68 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:35:18.597925 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-b1ef70de-6671-4e95-8e2d-81c1a2474a68 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:35:18.598557 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-b1ef70de-6671-4e95-8e2d-81c1a2474a68 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:35:18.841884 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-b1ef70de-6671-4e95-8e2d-81c1a2474a68 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f448776d1074e22bfe6cfbe05e01db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27fe465e6743e19feec424e6e9f3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:35:18.854722 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-b1ef70de-6671-4e95-8e2d-81c1a2474a68 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394" status: 200 len: 1507 microversion: 2.1 time: 0.273291 Jul 12 13:35:18.855693 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 336/666] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:35:18 2022] GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394 => generated 1507 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:35:18.886590 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [req-b27349c8-5887-4b13-a638-dc4cfbaf7a48 req-8622d2d1-d0ca-40c2-ad52-893ba3cf8d34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95edada5-d3ec-4056-99e9-379fb4b65394", "name": "network-vif-deleted", "tag": "46dc7639-cc9b-48c0-9d26-acdc89e2058e"}]} {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:35:18.897161 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [req-b27349c8-5887-4b13-a638-dc4cfbaf7a48 req-8622d2d1-d0ca-40c2-ad52-893ba3cf8d34 service nova] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:35:18.897700 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [req-b27349c8-5887-4b13-a638-dc4cfbaf7a48 req-8622d2d1-d0ca-40c2-ad52-893ba3cf8d34 service nova] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:35:18.912900 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.compute.server_external_events [req-b27349c8-5887-4b13-a638-dc4cfbaf7a48 req-8622d2d1-d0ca-40c2-ad52-893ba3cf8d34 service nova] Creating event network-vif-deleted:46dc7639-cc9b-48c0-9d26-acdc89e2058e for instance 95edada5-d3ec-4056-99e9-379fb4b65394 on hv-cinder-82002 Jul 12 13:35:18.918900 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [req-b27349c8-5887-4b13-a638-dc4cfbaf7a48 req-8622d2d1-d0ca-40c2-ad52-893ba3cf8d34 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036527 Jul 12 13:35:18.919515 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 331/667] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 12 13:35:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:35:19.872147 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-b2790d82-0ad3-4cf6-bbe1-1fc2ea6465b1 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:35:19.872800 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-b2790d82-0ad3-4cf6-bbe1-1fc2ea6465b1 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: 95edada5-d3ec-4056-99e9-379fb4b65394] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:35:19.879970 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-b2790d82-0ad3-4cf6-bbe1-1fc2ea6465b1 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:35:19.880419 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-b2790d82-0ad3-4cf6-bbe1-1fc2ea6465b1 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:35:19.881193 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-b2790d82-0ad3-4cf6-bbe1-1fc2ea6465b1 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:35:19.881676 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-b2790d82-0ad3-4cf6-bbe1-1fc2ea6465b1 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:35:19.896338 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.wsgi [None req-b2790d82-0ad3-4cf6-bbe1-1fc2ea6465b1 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] HTTP exception thrown: Instance 95edada5-d3ec-4056-99e9-379fb4b65394 could not be found. Jul 12 13:35:19.898012 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-b2790d82-0ad3-4cf6-bbe1-1fc2ea6465b1 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Request method failure captured: Jul 12 13:35:19.898012 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: request: GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394 HTTP/1.1 Jul 12 13:35:19.898012 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: Accept: application/json Jul 12 13:35:19.898012 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: Accept-Encoding: identity Jul 12 13:35:19.898012 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: Connection: close Jul 12 13:35:19.898012 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: Content-Length: 0 Jul 12 13:35:19.898012 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: Content-Type: application/json Jul 12 13:35:19.898012 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: Host: 10.222.0.23 Jul 12 13:35:19.898012 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: Openstack-System-Scope: None Jul 12 13:35:19.898012 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: User-Agent: python-urllib3/1.26.9 Jul 12 13:35:19.898012 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Auth-Token: gAAAAABizXbHaqiAqZhWBI-vk_o7a-bGHsret_K3_OESrsSqXK-GPMz9bPJQcG7LrA86KpPc4AMrjwGTn_JiGdYdVtYddlqLRSDG3IHGj5eQPo9N843Dt2ruWjpHNFsSPymDgsCEgYLfMLp_zHvOn_zPoeXgUvrsNthFZ_9cbS3sn5NZOuhEk88 Jul 12 13:35:19.898012 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Domain-Id: None Jul 12 13:35:19.898012 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Domain-Name: None Jul 12 13:35:19.898012 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Identity-Status: Confirmed Jul 12 13:35:19.898012 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Is-Admin-Project: True Jul 12 13:35:19.898012 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Project-Domain-Id: default Jul 12 13:35:19.898012 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Project-Domain-Name: Default Jul 12 13:35:19.898012 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Project-Id: 2c27fe465e6743e19feec424e6e9f3d1 Jul 12 13:35:19.898012 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-115734551 Jul 12 13:35:19.898012 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Role: reader,member Jul 12 13:35:19.898012 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Roles: reader,member Jul 12 13:35:19.899524 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2c27fe465e6743e19feec424e6e9f3d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2c27fe465e6743e19feec424e6e9f3d1", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2c27fe465e6743e19feec424e6e9f3d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2c27fe465e6743e19feec424e6e9f3d1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] Jul 12 13:35:19.899524 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Tenant: tempest-ServerRescueNegativeTestJSON-115734551 Jul 12 13:35:19.899524 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Tenant-Id: 2c27fe465e6743e19feec424e6e9f3d1 Jul 12 13:35:19.899524 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-115734551 Jul 12 13:35:19.899524 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-User: tempest-ServerRescueNegativeTestJSON-115734551-project Jul 12 13:35:19.899524 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-User-Domain-Id: default Jul 12 13:35:19.899524 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-User-Domain-Name: Default Jul 12 13:35:19.899524 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-User-Id: 8f448776d1074e22bfe6cfbe05e01db7 Jul 12 13:35:19.899524 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-User-Name: tempest-ServerRescueNegativeTestJSON-115734551-project Jul 12 13:35:19.899524 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: method: > Jul 12 13:35:19.899524 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: exception: Instance 95edada5-d3ec-4056-99e9-379fb4b65394 could not be found. Jul 12 13:35:19.899524 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: action_args: {'id': '95edada5-d3ec-4056-99e9-379fb4b65394'} Jul 12 13:35:19.900408 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 13:35:19.900408 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:35:19.900408 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 13:35:19.900408 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 13:35:19.900408 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 13:35:19.900408 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 13:35:19.900408 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 13:35:19.900408 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 13:35:19.900408 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 13:35:19.900408 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 13:35:19.900408 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95edada5-d3ec-4056-99e9-379fb4b65394 could not be found. Jul 12 13:35:19.900408 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi Jul 12 13:35:19.900408 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:35:19.900408 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi Jul 12 13:35:19.900408 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:35:19.900408 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:35:19.900408 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:35:19.900408 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 13:35:19.900408 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 13:35:19.900408 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 13:35:19.901671 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:35:19.901671 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 13:35:19.901671 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 13:35:19.901671 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 13:35:19.901671 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 13:35:19.901671 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 13:35:19.901671 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 13:35:19.901671 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95edada5-d3ec-4056-99e9-379fb4b65394 could not be found. Jul 12 13:35:19.901671 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi Jul 12 13:35:19.901671 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:35:19.901671 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi Jul 12 13:35:19.901671 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:35:19.901671 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:35:19.901671 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:35:19.901671 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 13:35:19.901671 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 13:35:19.901671 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95edada5-d3ec-4056-99e9-379fb4b65394 could not be found. Jul 12 13:35:19.901671 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi Jul 12 13:35:19.903207 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-b2790d82-0ad3-4cf6-bbe1-1fc2ea6465b1 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Returning 404 to user: Instance 95edada5-d3ec-4056-99e9-379fb4b65394 could not be found. {{(pid=117988) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 13:35:19.903207 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-b2790d82-0ad3-4cf6-bbe1-1fc2ea6465b1 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394" status: 404 len: 111 microversion: 2.1 time: 0.031250 Jul 12 13:35:19.903207 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 337/668] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:35:19 2022] GET /compute/v2.1/servers/95edada5-d3ec-4056-99e9-379fb4b65394 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 13:35:19.909274 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-4c86d422-3b74-489e-bfde-21994a44e5ab tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:35:19.909882 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-4c86d422-3b74-489e-bfde-21994a44e5ab tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: bf8dbed9-b15d-4daf-af11-7ee001424482] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:35:19.916102 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-4c86d422-3b74-489e-bfde-21994a44e5ab tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:35:19.916584 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-4c86d422-3b74-489e-bfde-21994a44e5ab tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:35:19.917343 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-4c86d422-3b74-489e-bfde-21994a44e5ab tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:35:19.917799 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-4c86d422-3b74-489e-bfde-21994a44e5ab tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:35:19.944028 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-4c86d422-3b74-489e-bfde-21994a44e5ab tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: bf8dbed9-b15d-4daf-af11-7ee001424482] Going to try to terminate instance {{(pid=117987) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 13:35:20.024489 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-4c86d422-3b74-489e-bfde-21994a44e5ab tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "DELETE /compute/v2.1/servers/bf8dbed9-b15d-4daf-af11-7ee001424482" status: 204 len: 0 microversion: 2.1 time: 0.119564 Jul 12 13:35:20.025455 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 332/669] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 12 13:35:19 2022] DELETE /compute/v2.1/servers/bf8dbed9-b15d-4daf-af11-7ee001424482 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 13:35:20.034281 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-4b545da3-1ceb-4c3d-bdb6-f3fe4a73f4cd tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:35:20.034902 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-4b545da3-1ceb-4c3d-bdb6-f3fe4a73f4cd tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: bf8dbed9-b15d-4daf-af11-7ee001424482] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:35:20.041033 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-4b545da3-1ceb-4c3d-bdb6-f3fe4a73f4cd tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:35:20.041537 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-4b545da3-1ceb-4c3d-bdb6-f3fe4a73f4cd tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:35:20.042305 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-4b545da3-1ceb-4c3d-bdb6-f3fe4a73f4cd tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:35:20.042738 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-4b545da3-1ceb-4c3d-bdb6-f3fe4a73f4cd tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:35:20.176105 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-4b545da3-1ceb-4c3d-bdb6-f3fe4a73f4cd tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f448776d1074e22bfe6cfbe05e01db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27fe465e6743e19feec424e6e9f3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:35:20.183650 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-4b545da3-1ceb-4c3d-bdb6-f3fe4a73f4cd tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "GET /compute/v2.1/servers/bf8dbed9-b15d-4daf-af11-7ee001424482" status: 200 len: 1523 microversion: 2.1 time: 0.153776 Jul 12 13:35:20.184221 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 338/670] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:35:20 2022] GET /compute/v2.1/servers/bf8dbed9-b15d-4daf-af11-7ee001424482 => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:35:21.203105 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-a8a7ec67-b7d6-4963-9db0-bc98d83c3477 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:35:21.203821 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-a8a7ec67-b7d6-4963-9db0-bc98d83c3477 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: bf8dbed9-b15d-4daf-af11-7ee001424482] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:35:21.211178 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-a8a7ec67-b7d6-4963-9db0-bc98d83c3477 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:35:21.211755 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-a8a7ec67-b7d6-4963-9db0-bc98d83c3477 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:35:21.212542 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-a8a7ec67-b7d6-4963-9db0-bc98d83c3477 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:35:21.212980 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-a8a7ec67-b7d6-4963-9db0-bc98d83c3477 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:35:21.426983 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-a8a7ec67-b7d6-4963-9db0-bc98d83c3477 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f448776d1074e22bfe6cfbe05e01db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27fe465e6743e19feec424e6e9f3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:35:21.452951 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-a8a7ec67-b7d6-4963-9db0-bc98d83c3477 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "GET /compute/v2.1/servers/bf8dbed9-b15d-4daf-af11-7ee001424482" status: 200 len: 1523 microversion: 2.1 time: 0.254736 Jul 12 13:35:21.453899 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 333/671] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:35:21 2022] GET /compute/v2.1/servers/bf8dbed9-b15d-4daf-af11-7ee001424482 => generated 1523 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:35:21.622998 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [req-5501933f-6b13-41bc-84a9-f55abd587202 req-85ef6662-a8b9-48f9-9272-cc8c3f03ef34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf8dbed9-b15d-4daf-af11-7ee001424482", "name": "network-vif-deleted", "tag": "e63ff95a-51aa-4e9d-85c0-b21397806ede"}]} {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:35:21.635525 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [req-5501933f-6b13-41bc-84a9-f55abd587202 req-85ef6662-a8b9-48f9-9272-cc8c3f03ef34 service nova] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:35:21.635963 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [req-5501933f-6b13-41bc-84a9-f55abd587202 req-85ef6662-a8b9-48f9-9272-cc8c3f03ef34 service nova] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:35:21.649010 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.compute.server_external_events [req-5501933f-6b13-41bc-84a9-f55abd587202 req-85ef6662-a8b9-48f9-9272-cc8c3f03ef34 service nova] Creating event network-vif-deleted:e63ff95a-51aa-4e9d-85c0-b21397806ede for instance bf8dbed9-b15d-4daf-af11-7ee001424482 on hv-cinder-82002 Jul 12 13:35:21.654892 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [req-5501933f-6b13-41bc-84a9-f55abd587202 req-85ef6662-a8b9-48f9-9272-cc8c3f03ef34 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035349 Jul 12 13:35:21.655542 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 339/672] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 12 13:35:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:35:22.471067 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-e13efb47-939b-4f8c-a99d-9302e8bb1f71 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:35:22.471663 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-e13efb47-939b-4f8c-a99d-9302e8bb1f71 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] [instance: bf8dbed9-b15d-4daf-af11-7ee001424482] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:35:22.478376 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-e13efb47-939b-4f8c-a99d-9302e8bb1f71 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:35:22.478819 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-e13efb47-939b-4f8c-a99d-9302e8bb1f71 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:35:22.479583 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-e13efb47-939b-4f8c-a99d-9302e8bb1f71 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:35:22.480010 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-e13efb47-939b-4f8c-a99d-9302e8bb1f71 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:35:22.493749 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.wsgi [None req-e13efb47-939b-4f8c-a99d-9302e8bb1f71 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] HTTP exception thrown: Instance bf8dbed9-b15d-4daf-af11-7ee001424482 could not be found. Jul 12 13:35:22.495410 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-e13efb47-939b-4f8c-a99d-9302e8bb1f71 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Request method failure captured: Jul 12 13:35:22.495410 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: request: GET /compute/v2.1/servers/bf8dbed9-b15d-4daf-af11-7ee001424482 HTTP/1.1 Jul 12 13:35:22.495410 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: Accept: application/json Jul 12 13:35:22.495410 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: Accept-Encoding: identity Jul 12 13:35:22.495410 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: Connection: close Jul 12 13:35:22.495410 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: Content-Length: 0 Jul 12 13:35:22.495410 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: Content-Type: application/json Jul 12 13:35:22.495410 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: Host: 10.222.0.23 Jul 12 13:35:22.495410 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: Openstack-System-Scope: None Jul 12 13:35:22.495410 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: User-Agent: python-urllib3/1.26.9 Jul 12 13:35:22.495410 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Auth-Token: gAAAAABizXbHaqiAqZhWBI-vk_o7a-bGHsret_K3_OESrsSqXK-GPMz9bPJQcG7LrA86KpPc4AMrjwGTn_JiGdYdVtYddlqLRSDG3IHGj5eQPo9N843Dt2ruWjpHNFsSPymDgsCEgYLfMLp_zHvOn_zPoeXgUvrsNthFZ_9cbS3sn5NZOuhEk88 Jul 12 13:35:22.495410 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Domain-Id: None Jul 12 13:35:22.495410 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Domain-Name: None Jul 12 13:35:22.495410 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Identity-Status: Confirmed Jul 12 13:35:22.495410 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Is-Admin-Project: True Jul 12 13:35:22.495410 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Project-Domain-Id: default Jul 12 13:35:22.495410 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Project-Domain-Name: Default Jul 12 13:35:22.495410 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Project-Id: 2c27fe465e6743e19feec424e6e9f3d1 Jul 12 13:35:22.495410 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-115734551 Jul 12 13:35:22.495410 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Role: reader,member Jul 12 13:35:22.495410 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Roles: reader,member Jul 12 13:35:22.496940 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2c27fe465e6743e19feec424e6e9f3d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2c27fe465e6743e19feec424e6e9f3d1", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2c27fe465e6743e19feec424e6e9f3d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2c27fe465e6743e19feec424e6e9f3d1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] Jul 12 13:35:22.496940 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Tenant: tempest-ServerRescueNegativeTestJSON-115734551 Jul 12 13:35:22.496940 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Tenant-Id: 2c27fe465e6743e19feec424e6e9f3d1 Jul 12 13:35:22.496940 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-115734551 Jul 12 13:35:22.496940 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-User: tempest-ServerRescueNegativeTestJSON-115734551-project Jul 12 13:35:22.496940 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-User-Domain-Id: default Jul 12 13:35:22.496940 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-User-Domain-Name: Default Jul 12 13:35:22.496940 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-User-Id: 8f448776d1074e22bfe6cfbe05e01db7 Jul 12 13:35:22.496940 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-User-Name: tempest-ServerRescueNegativeTestJSON-115734551-project Jul 12 13:35:22.496940 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: method: > Jul 12 13:35:22.496940 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: exception: Instance bf8dbed9-b15d-4daf-af11-7ee001424482 could not be found. Jul 12 13:35:22.496940 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: action_args: {'id': 'bf8dbed9-b15d-4daf-af11-7ee001424482'} Jul 12 13:35:22.497802 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 13:35:22.497802 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:35:22.497802 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 13:35:22.497802 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 13:35:22.497802 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 13:35:22.497802 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 13:35:22.497802 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 13:35:22.497802 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 13:35:22.497802 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 13:35:22.497802 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 13:35:22.497802 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf8dbed9-b15d-4daf-af11-7ee001424482 could not be found. Jul 12 13:35:22.497802 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi Jul 12 13:35:22.497802 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:35:22.497802 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi Jul 12 13:35:22.497802 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:35:22.497802 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:35:22.497802 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:35:22.497802 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 13:35:22.497802 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 13:35:22.497802 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 13:35:22.499170 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:35:22.499170 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 13:35:22.499170 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 13:35:22.499170 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 13:35:22.499170 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 13:35:22.499170 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 13:35:22.499170 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 13:35:22.499170 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf8dbed9-b15d-4daf-af11-7ee001424482 could not be found. Jul 12 13:35:22.499170 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi Jul 12 13:35:22.499170 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:35:22.499170 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi Jul 12 13:35:22.499170 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:35:22.499170 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:35:22.499170 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:35:22.499170 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 13:35:22.499170 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 13:35:22.499170 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf8dbed9-b15d-4daf-af11-7ee001424482 could not be found. Jul 12 13:35:22.499170 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi Jul 12 13:35:22.500449 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-e13efb47-939b-4f8c-a99d-9302e8bb1f71 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] Returning 404 to user: Instance bf8dbed9-b15d-4daf-af11-7ee001424482 could not be found. {{(pid=117987) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 13:35:22.500449 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-e13efb47-939b-4f8c-a99d-9302e8bb1f71 tempest-ServerRescueNegativeTestJSON-115734551 tempest-ServerRescueNegativeTestJSON-115734551-project] 10.222.0.23 "GET /compute/v2.1/servers/bf8dbed9-b15d-4daf-af11-7ee001424482" status: 404 len: 111 microversion: 2.1 time: 0.029763 Jul 12 13:35:22.500449 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 334/673] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:35:22 2022] GET /compute/v2.1/servers/bf8dbed9-b15d-4daf-af11-7ee001424482 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 13:35:28.581711 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-1f82b233-edab-4ff3-b586-f22615db580b tempest-VolumesTestJSON-870828606 tempest-VolumesTestJSON-870828606-project] Calling method '.version_select at 0x7f76ea1cc0d0>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:35:28.631617 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-1f82b233-edab-4ff3-b586-f22615db580b tempest-VolumesTestJSON-870828606 tempest-VolumesTestJSON-870828606-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/1ea95f35-cfd6-4a87-bee0-9f4e72c49f92" status: 200 len: 351 microversion: 2.1 time: 0.056288 Jul 12 13:35:28.632190 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 340/674] 10.222.0.23 () {58 vars in 1244 bytes} [Tue Jul 12 13:35:28 2022] GET /compute/v2.1/os-volumes/1ea95f35-cfd6-4a87-bee0-9f4e72c49f92 => generated 351 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:35:29.969049 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-5dd7bdbc-9000-414d-a6e4-7adbacfd4beb tempest-VolumesTestJSON-870828606 tempest-VolumesTestJSON-870828606-project] Calling method '.version_select at 0x7f76e90895e0>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:35:30.018196 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-5dd7bdbc-9000-414d-a6e4-7adbacfd4beb tempest-VolumesTestJSON-870828606 tempest-VolumesTestJSON-870828606-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/af2942e2-3bb5-4ed2-ac01-c03e65b36730" status: 200 len: 351 microversion: 2.1 time: 0.052210 Jul 12 13:35:30.018764 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 335/675] 10.222.0.23 () {58 vars in 1244 bytes} [Tue Jul 12 13:35:29 2022] GET /compute/v2.1/os-volumes/af2942e2-3bb5-4ed2-ac01-c03e65b36730 => generated 351 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:35:31.334509 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-2124c09f-4aa7-4b38-87ee-70b1dda083ba tempest-VolumesTestJSON-870828606 tempest-VolumesTestJSON-870828606-project] Calling method '.version_select at 0x7f76ea15d5e0>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:35:31.381267 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-2124c09f-4aa7-4b38-87ee-70b1dda083ba tempest-VolumesTestJSON-870828606 tempest-VolumesTestJSON-870828606-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/b83e2d7c-5b8c-4b84-93db-cd0ad8e2481d" status: 200 len: 350 microversion: 2.1 time: 0.051090 Jul 12 13:35:31.381950 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 341/676] 10.222.0.23 () {58 vars in 1244 bytes} [Tue Jul 12 13:35:31 2022] GET /compute/v2.1/os-volumes/b83e2d7c-5b8c-4b84-93db-cd0ad8e2481d => generated 350 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:35:31.393575 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-8e697302-8b39-4fe4-9d8b-1e5ecde68980 tempest-VolumesTestJSON-870828606 tempest-VolumesTestJSON-870828606-project] Calling method '.version_select at 0x7f76e91051f0>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:35:31.477970 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-8e697302-8b39-4fe4-9d8b-1e5ecde68980 tempest-VolumesTestJSON-870828606 tempest-VolumesTestJSON-870828606-project] 10.222.0.23 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.088305 Jul 12 13:35:31.478541 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 336/677] 10.222.0.23 () {58 vars in 1133 bytes} [Tue Jul 12 13:35:31 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:35:31.491342 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-1aad090b-b548-4e16-85ef-c4b677c7e3d5 tempest-VolumesTestJSON-870828606 tempest-VolumesTestJSON-870828606-project] Calling method '.version_select at 0x7f76ea133e50>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:35:31.577182 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-1aad090b-b548-4e16-85ef-c4b677c7e3d5 tempest-VolumesTestJSON-870828606 tempest-VolumesTestJSON-870828606-project] 10.222.0.23 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.090392 Jul 12 13:35:31.577783 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 342/678] 10.222.0.23 () {58 vars in 1148 bytes} [Tue Jul 12 13:35:31 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:35:31.590005 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-39d03389-16fe-434b-afec-0bf3a5f6f368 tempest-VolumesTestJSON-870828606 tempest-VolumesTestJSON-870828606-project] Calling method '.version_select at 0x7f76e90e6310>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:35:31.671422 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-39d03389-16fe-434b-afec-0bf3a5f6f368 tempest-VolumesTestJSON-870828606 tempest-VolumesTestJSON-870828606-project] 10.222.0.23 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.085213 Jul 12 13:35:31.671990 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 337/679] 10.222.0.23 () {58 vars in 1133 bytes} [Tue Jul 12 13:35:31 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:35:31.680229 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG dbcounter [-] [117988] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1 {{(pid=117988) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:35:31.680986 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG dbcounter [-] [117988] Writing DB stats nova_cell1:SELECT=29,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117988) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:35:31.684880 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-1ece122d-d95b-42a1-bab4-11750fa4bb85 tempest-VolumesTestJSON-870828606 tempest-VolumesTestJSON-870828606-project] Calling method '.version_select at 0x7f76ea1338b0>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:35:31.766642 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-1ece122d-d95b-42a1-bab4-11750fa4bb85 tempest-VolumesTestJSON-870828606 tempest-VolumesTestJSON-870828606-project] 10.222.0.23 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.087153 Jul 12 13:35:31.767214 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 343/680] 10.222.0.23 () {58 vars in 1166 bytes} [Tue Jul 12 13:35:31 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:35:31.779673 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-1e895dfa-b635-4196-b94d-d42936d0e233 tempest-VolumesTestJSON-870828606 tempest-VolumesTestJSON-870828606-project] Calling method '.version_select at 0x7f76e9089b80>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:35:31.861185 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-1e895dfa-b635-4196-b94d-d42936d0e233 tempest-VolumesTestJSON-870828606 tempest-VolumesTestJSON-870828606-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.085435 Jul 12 13:35:31.861875 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 338/681] 10.222.0.23 () {58 vars in 1169 bytes} [Tue Jul 12 13:35:31 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:35:31.873823 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-601da455-fd74-4e16-b46a-96e59e857422 tempest-VolumesTestJSON-870828606 tempest-VolumesTestJSON-870828606-project] Calling method '.version_select at 0x7f76ea1cce50>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:35:31.954414 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-601da455-fd74-4e16-b46a-96e59e857422 tempest-VolumesTestJSON-870828606 tempest-VolumesTestJSON-870828606-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.084268 Jul 12 13:35:31.955064 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 344/682] 10.222.0.23 () {58 vars in 1154 bytes} [Tue Jul 12 13:35:31 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:35:31.966869 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-b352b747-39f6-469c-ae06-27effbc45765 tempest-VolumesTestJSON-870828606 tempest-VolumesTestJSON-870828606-project] Calling method '.version_select at 0x7f76e90d8c10>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:35:32.053317 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-b352b747-39f6-469c-ae06-27effbc45765 tempest-VolumesTestJSON-870828606 tempest-VolumesTestJSON-870828606-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.089833 Jul 12 13:35:32.054507 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 339/683] 10.222.0.23 () {58 vars in 1187 bytes} [Tue Jul 12 13:35:31 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:35:32.071732 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-42a8f005-65a8-4e2f-abb9-30dbb691d386 tempest-VolumesTestJSON-870828606 tempest-VolumesTestJSON-870828606-project] Calling method '.version_select at 0x7f76ea123280>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:35:32.154577 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-42a8f005-65a8-4e2f-abb9-30dbb691d386 tempest-VolumesTestJSON-870828606 tempest-VolumesTestJSON-870828606-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.086752 Jul 12 13:35:32.155154 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 345/684] 10.222.0.23 () {58 vars in 1154 bytes} [Tue Jul 12 13:35:32 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:35:52.218702 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG dbcounter [-] [117987] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1 {{(pid=117987) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:35:52.219550 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG dbcounter [-] [117987] Writing DB stats nova_cell1:SELECT=29,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117987) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:35:52.224625 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-88841649-0111-4d36-b7db-e5271395161b tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:35:52.225124 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-88841649-0111-4d36-b7db-e5271395161b tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 90cd5e2a-127d-4329-93ff-1a8dc66cf049] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:35:52.232893 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-88841649-0111-4d36-b7db-e5271395161b tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:35:52.233333 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-88841649-0111-4d36-b7db-e5271395161b tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:35:52.234282 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-88841649-0111-4d36-b7db-e5271395161b tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:35:52.234708 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-88841649-0111-4d36-b7db-e5271395161b tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:35:52.261080 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-88841649-0111-4d36-b7db-e5271395161b tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/90cd5e2a-127d-4329-93ff-1a8dc66cf049/ips" status: 200 len: 151 microversion: 2.20 time: 0.043636 Jul 12 13:35:52.266679 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 340/685] 10.222.0.23 () {60 vars in 1288 bytes} [Tue Jul 12 13:35:52 2022] GET /compute/v2.1/servers/90cd5e2a-127d-4329-93ff-1a8dc66cf049/ips => generated 151 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 13:35:54.224257 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-da4279f1-897c-413c-889b-a8cfeba9548f tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:35:54.225026 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-da4279f1-897c-413c-889b-a8cfeba9548f tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 90cd5e2a-127d-4329-93ff-1a8dc66cf049] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:35:54.231616 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-da4279f1-897c-413c-889b-a8cfeba9548f tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:35:54.232082 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-da4279f1-897c-413c-889b-a8cfeba9548f tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:35:54.232844 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-da4279f1-897c-413c-889b-a8cfeba9548f tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:35:54.233277 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-da4279f1-897c-413c-889b-a8cfeba9548f tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:35:54.258334 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.objects.instance [None req-da4279f1-897c-413c-889b-a8cfeba9548f tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lazy-loading 'flavor' on Instance uuid 90cd5e2a-127d-4329-93ff-1a8dc66cf049 {{(pid=117988) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 13:35:54.543890 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-da4279f1-897c-413c-889b-a8cfeba9548f tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "POST /compute/v2.1/servers/90cd5e2a-127d-4329-93ff-1a8dc66cf049/action" status: 202 len: 0 microversion: 2.20 time: 0.324978 Jul 12 13:35:54.544702 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 346/686] 10.222.0.23 () {62 vars in 1318 bytes} [Tue Jul 12 13:35:54 2022] POST /compute/v2.1/servers/90cd5e2a-127d-4329-93ff-1a8dc66cf049/action => generated 0 bytes in 327 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 12 13:35:54.555647 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-498e2e6f-4680-4834-8600-8892f305c950 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:35:54.556190 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-498e2e6f-4680-4834-8600-8892f305c950 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 90cd5e2a-127d-4329-93ff-1a8dc66cf049] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:35:54.563277 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-498e2e6f-4680-4834-8600-8892f305c950 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:35:54.563560 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-498e2e6f-4680-4834-8600-8892f305c950 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:35:54.564400 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-498e2e6f-4680-4834-8600-8892f305c950 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:35:54.564869 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-498e2e6f-4680-4834-8600-8892f305c950 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:35:54.710150 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-498e2e6f-4680-4834-8600-8892f305c950 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:35:54.718508 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-498e2e6f-4680-4834-8600-8892f305c950 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:35:54.720005 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-498e2e6f-4680-4834-8600-8892f305c950 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:35:54.721681 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-498e2e6f-4680-4834-8600-8892f305c950 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/90cd5e2a-127d-4329-93ff-1a8dc66cf049" status: 200 len: 1722 microversion: 2.20 time: 0.169549 Jul 12 13:35:54.722462 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 341/687] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:35:54 2022] GET /compute/v2.1/servers/90cd5e2a-127d-4329-93ff-1a8dc66cf049 => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:35:55.741923 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-60ee19e0-1ef7-4e8c-b2b6-c60deeacfc99 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:35:55.743343 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-60ee19e0-1ef7-4e8c-b2b6-c60deeacfc99 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 90cd5e2a-127d-4329-93ff-1a8dc66cf049] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:35:55.750238 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-60ee19e0-1ef7-4e8c-b2b6-c60deeacfc99 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:35:55.750689 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-60ee19e0-1ef7-4e8c-b2b6-c60deeacfc99 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:35:55.751588 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-60ee19e0-1ef7-4e8c-b2b6-c60deeacfc99 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:35:55.752019 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-60ee19e0-1ef7-4e8c-b2b6-c60deeacfc99 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:35:55.898138 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-60ee19e0-1ef7-4e8c-b2b6-c60deeacfc99 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:35:55.907153 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-60ee19e0-1ef7-4e8c-b2b6-c60deeacfc99 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:35:55.908657 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-60ee19e0-1ef7-4e8c-b2b6-c60deeacfc99 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:35:55.910654 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-60ee19e0-1ef7-4e8c-b2b6-c60deeacfc99 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/90cd5e2a-127d-4329-93ff-1a8dc66cf049" status: 200 len: 1722 microversion: 2.20 time: 0.173285 Jul 12 13:35:55.911338 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 347/688] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:35:55 2022] GET /compute/v2.1/servers/90cd5e2a-127d-4329-93ff-1a8dc66cf049 => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:35:56.936107 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-8f780885-54be-4f34-b9a0-e67312bbfc04 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:35:56.936774 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-8f780885-54be-4f34-b9a0-e67312bbfc04 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 90cd5e2a-127d-4329-93ff-1a8dc66cf049] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:35:56.944753 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-8f780885-54be-4f34-b9a0-e67312bbfc04 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:35:56.945198 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-8f780885-54be-4f34-b9a0-e67312bbfc04 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:35:56.945988 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-8f780885-54be-4f34-b9a0-e67312bbfc04 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:35:56.946416 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-8f780885-54be-4f34-b9a0-e67312bbfc04 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:35:57.104819 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-8f780885-54be-4f34-b9a0-e67312bbfc04 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:35:57.113652 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-8f780885-54be-4f34-b9a0-e67312bbfc04 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:35:57.115167 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-8f780885-54be-4f34-b9a0-e67312bbfc04 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:35:57.116353 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-8f780885-54be-4f34-b9a0-e67312bbfc04 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/90cd5e2a-127d-4329-93ff-1a8dc66cf049" status: 200 len: 1722 microversion: 2.20 time: 0.184162 Jul 12 13:35:57.116930 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 342/689] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:35:56 2022] GET /compute/v2.1/servers/90cd5e2a-127d-4329-93ff-1a8dc66cf049 => generated 1722 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:35:58.134683 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-59107f40-281b-4509-91f1-87a77456dcc6 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:35:58.135575 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-59107f40-281b-4509-91f1-87a77456dcc6 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 90cd5e2a-127d-4329-93ff-1a8dc66cf049] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:35:58.146804 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-59107f40-281b-4509-91f1-87a77456dcc6 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:35:58.147725 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-59107f40-281b-4509-91f1-87a77456dcc6 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:35:58.148522 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-59107f40-281b-4509-91f1-87a77456dcc6 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:35:58.148959 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-59107f40-281b-4509-91f1-87a77456dcc6 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:35:58.293166 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-59107f40-281b-4509-91f1-87a77456dcc6 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:35:58.302185 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-59107f40-281b-4509-91f1-87a77456dcc6 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:35:58.304188 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-59107f40-281b-4509-91f1-87a77456dcc6 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:35:58.305478 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-59107f40-281b-4509-91f1-87a77456dcc6 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/90cd5e2a-127d-4329-93ff-1a8dc66cf049" status: 200 len: 1722 microversion: 2.20 time: 0.174883 Jul 12 13:35:58.306086 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 348/690] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:35:58 2022] GET /compute/v2.1/servers/90cd5e2a-127d-4329-93ff-1a8dc66cf049 => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 13:35:59.333006 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-46cdd74a-f0d2-4ade-8a13-bc4f9b0549f5 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:35:59.333752 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-46cdd74a-f0d2-4ade-8a13-bc4f9b0549f5 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 90cd5e2a-127d-4329-93ff-1a8dc66cf049] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:35:59.340244 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-46cdd74a-f0d2-4ade-8a13-bc4f9b0549f5 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:35:59.340694 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-46cdd74a-f0d2-4ade-8a13-bc4f9b0549f5 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:35:59.341495 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-46cdd74a-f0d2-4ade-8a13-bc4f9b0549f5 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:35:59.341943 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-46cdd74a-f0d2-4ade-8a13-bc4f9b0549f5 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:35:59.485482 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-46cdd74a-f0d2-4ade-8a13-bc4f9b0549f5 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:35:59.494677 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-46cdd74a-f0d2-4ade-8a13-bc4f9b0549f5 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:35:59.496237 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-46cdd74a-f0d2-4ade-8a13-bc4f9b0549f5 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:35:59.497508 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-46cdd74a-f0d2-4ade-8a13-bc4f9b0549f5 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/90cd5e2a-127d-4329-93ff-1a8dc66cf049" status: 200 len: 1722 microversion: 2.20 time: 0.169376 Jul 12 13:35:59.498153 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 343/691] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:35:59 2022] GET /compute/v2.1/servers/90cd5e2a-127d-4329-93ff-1a8dc66cf049 => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:36:00.515896 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-1b164a42-3a39-4bbb-b1db-7f87718053a8 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:36:00.516614 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-1b164a42-3a39-4bbb-b1db-7f87718053a8 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 90cd5e2a-127d-4329-93ff-1a8dc66cf049] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:36:00.524234 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-1b164a42-3a39-4bbb-b1db-7f87718053a8 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:00.524776 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-1b164a42-3a39-4bbb-b1db-7f87718053a8 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:00.525647 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-1b164a42-3a39-4bbb-b1db-7f87718053a8 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:00.526337 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-1b164a42-3a39-4bbb-b1db-7f87718053a8 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:00.678367 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-1b164a42-3a39-4bbb-b1db-7f87718053a8 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:00.689504 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-1b164a42-3a39-4bbb-b1db-7f87718053a8 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:00.691587 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-1b164a42-3a39-4bbb-b1db-7f87718053a8 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:00.693326 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-1b164a42-3a39-4bbb-b1db-7f87718053a8 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/90cd5e2a-127d-4329-93ff-1a8dc66cf049" status: 200 len: 1722 microversion: 2.20 time: 0.181326 Jul 12 13:36:00.694050 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 349/692] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:36:00 2022] GET /compute/v2.1/servers/90cd5e2a-127d-4329-93ff-1a8dc66cf049 => generated 1722 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:36:01.713444 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-f90e732d-0420-448a-8e8c-13d922f8e1df tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:36:01.714360 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-f90e732d-0420-448a-8e8c-13d922f8e1df tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 90cd5e2a-127d-4329-93ff-1a8dc66cf049] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:36:01.722390 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-f90e732d-0420-448a-8e8c-13d922f8e1df tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:01.722884 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-f90e732d-0420-448a-8e8c-13d922f8e1df tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:01.723677 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-f90e732d-0420-448a-8e8c-13d922f8e1df tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:01.724114 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-f90e732d-0420-448a-8e8c-13d922f8e1df tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:01.862948 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-f90e732d-0420-448a-8e8c-13d922f8e1df tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:01.871229 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-f90e732d-0420-448a-8e8c-13d922f8e1df tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:01.872720 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-f90e732d-0420-448a-8e8c-13d922f8e1df tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:01.873902 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-f90e732d-0420-448a-8e8c-13d922f8e1df tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/90cd5e2a-127d-4329-93ff-1a8dc66cf049" status: 200 len: 1722 microversion: 2.20 time: 0.165615 Jul 12 13:36:01.874583 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 344/693] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:36:01 2022] GET /compute/v2.1/servers/90cd5e2a-127d-4329-93ff-1a8dc66cf049 => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:36:02.894563 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-1f328479-4085-476d-b123-2b9d67a73178 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:36:02.895387 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-1f328479-4085-476d-b123-2b9d67a73178 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 90cd5e2a-127d-4329-93ff-1a8dc66cf049] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:36:02.903662 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-1f328479-4085-476d-b123-2b9d67a73178 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:02.904228 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-1f328479-4085-476d-b123-2b9d67a73178 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:02.905291 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-1f328479-4085-476d-b123-2b9d67a73178 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:02.905970 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-1f328479-4085-476d-b123-2b9d67a73178 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:03.051096 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-1f328479-4085-476d-b123-2b9d67a73178 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:03.059231 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-1f328479-4085-476d-b123-2b9d67a73178 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:03.060757 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-1f328479-4085-476d-b123-2b9d67a73178 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:03.061986 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-1f328479-4085-476d-b123-2b9d67a73178 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/90cd5e2a-127d-4329-93ff-1a8dc66cf049" status: 200 len: 1722 microversion: 2.20 time: 0.172798 Jul 12 13:36:03.062579 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 350/694] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:36:02 2022] GET /compute/v2.1/servers/90cd5e2a-127d-4329-93ff-1a8dc66cf049 => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:36:04.083960 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-01a90873-8854-4a75-9348-7a0b29df8eb4 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:36:04.084755 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-01a90873-8854-4a75-9348-7a0b29df8eb4 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 90cd5e2a-127d-4329-93ff-1a8dc66cf049] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:36:04.091689 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-01a90873-8854-4a75-9348-7a0b29df8eb4 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:04.092131 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-01a90873-8854-4a75-9348-7a0b29df8eb4 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:04.092931 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-01a90873-8854-4a75-9348-7a0b29df8eb4 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:04.093359 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-01a90873-8854-4a75-9348-7a0b29df8eb4 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:04.235055 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-01a90873-8854-4a75-9348-7a0b29df8eb4 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:04.244786 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-01a90873-8854-4a75-9348-7a0b29df8eb4 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:04.247890 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-01a90873-8854-4a75-9348-7a0b29df8eb4 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:04.250506 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-01a90873-8854-4a75-9348-7a0b29df8eb4 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/90cd5e2a-127d-4329-93ff-1a8dc66cf049" status: 200 len: 1722 microversion: 2.20 time: 0.170608 Jul 12 13:36:04.250950 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 345/695] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:36:04 2022] GET /compute/v2.1/servers/90cd5e2a-127d-4329-93ff-1a8dc66cf049 => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:36:05.268447 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-b317cf7c-655b-4da0-9d64-bb51282f718e tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:36:05.269167 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-b317cf7c-655b-4da0-9d64-bb51282f718e tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 90cd5e2a-127d-4329-93ff-1a8dc66cf049] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:36:05.276050 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-b317cf7c-655b-4da0-9d64-bb51282f718e tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:05.276496 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-b317cf7c-655b-4da0-9d64-bb51282f718e tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:05.277273 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-b317cf7c-655b-4da0-9d64-bb51282f718e tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:05.277740 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-b317cf7c-655b-4da0-9d64-bb51282f718e tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:05.432706 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-b317cf7c-655b-4da0-9d64-bb51282f718e tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:05.440937 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-b317cf7c-655b-4da0-9d64-bb51282f718e tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:05.442702 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-b317cf7c-655b-4da0-9d64-bb51282f718e tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:05.443904 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-b317cf7c-655b-4da0-9d64-bb51282f718e tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/90cd5e2a-127d-4329-93ff-1a8dc66cf049" status: 200 len: 1722 microversion: 2.20 time: 0.179345 Jul 12 13:36:05.444682 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 351/696] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:36:05 2022] GET /compute/v2.1/servers/90cd5e2a-127d-4329-93ff-1a8dc66cf049 => generated 1722 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:36:06.462284 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-e6a50631-9e4d-43da-a1c7-742d37419639 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:36:06.462900 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-e6a50631-9e4d-43da-a1c7-742d37419639 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 90cd5e2a-127d-4329-93ff-1a8dc66cf049] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:36:06.470016 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-e6a50631-9e4d-43da-a1c7-742d37419639 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:06.471164 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-e6a50631-9e4d-43da-a1c7-742d37419639 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:06.472164 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-e6a50631-9e4d-43da-a1c7-742d37419639 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:06.472697 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-e6a50631-9e4d-43da-a1c7-742d37419639 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:06.622785 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-e6a50631-9e4d-43da-a1c7-742d37419639 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:06.632039 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-e6a50631-9e4d-43da-a1c7-742d37419639 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:06.633589 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-e6a50631-9e4d-43da-a1c7-742d37419639 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:06.634766 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-e6a50631-9e4d-43da-a1c7-742d37419639 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/90cd5e2a-127d-4329-93ff-1a8dc66cf049" status: 200 len: 1722 microversion: 2.20 time: 0.176422 Jul 12 13:36:06.635325 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 346/697] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:36:06 2022] GET /compute/v2.1/servers/90cd5e2a-127d-4329-93ff-1a8dc66cf049 => generated 1722 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:36:07.654593 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-6ae1f4b1-dc89-4f4b-aa33-c87f70a12228 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:36:07.655291 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-6ae1f4b1-dc89-4f4b-aa33-c87f70a12228 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 90cd5e2a-127d-4329-93ff-1a8dc66cf049] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:36:07.663621 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-6ae1f4b1-dc89-4f4b-aa33-c87f70a12228 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:07.664509 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-6ae1f4b1-dc89-4f4b-aa33-c87f70a12228 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:07.665902 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-6ae1f4b1-dc89-4f4b-aa33-c87f70a12228 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:07.667057 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-6ae1f4b1-dc89-4f4b-aa33-c87f70a12228 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:07.918113 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-6ae1f4b1-dc89-4f4b-aa33-c87f70a12228 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:07.929079 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-6ae1f4b1-dc89-4f4b-aa33-c87f70a12228 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:07.930785 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-6ae1f4b1-dc89-4f4b-aa33-c87f70a12228 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:07.932489 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-6ae1f4b1-dc89-4f4b-aa33-c87f70a12228 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/90cd5e2a-127d-4329-93ff-1a8dc66cf049" status: 200 len: 1722 microversion: 2.20 time: 0.281996 Jul 12 13:36:07.933198 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 352/698] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:36:07 2022] GET /compute/v2.1/servers/90cd5e2a-127d-4329-93ff-1a8dc66cf049 => generated 1722 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:36:08.951628 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-6de1db24-3c6c-416a-95df-e3316d8ecf72 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:36:08.952212 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-6de1db24-3c6c-416a-95df-e3316d8ecf72 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 90cd5e2a-127d-4329-93ff-1a8dc66cf049] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:36:08.958833 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-6de1db24-3c6c-416a-95df-e3316d8ecf72 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:08.959289 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-6de1db24-3c6c-416a-95df-e3316d8ecf72 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:08.960066 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-6de1db24-3c6c-416a-95df-e3316d8ecf72 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:08.960496 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-6de1db24-3c6c-416a-95df-e3316d8ecf72 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:09.104667 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-6de1db24-3c6c-416a-95df-e3316d8ecf72 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:09.113354 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-6de1db24-3c6c-416a-95df-e3316d8ecf72 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:09.115683 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-6de1db24-3c6c-416a-95df-e3316d8ecf72 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:09.116867 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-6de1db24-3c6c-416a-95df-e3316d8ecf72 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/90cd5e2a-127d-4329-93ff-1a8dc66cf049" status: 200 len: 1722 microversion: 2.20 time: 0.169241 Jul 12 13:36:09.117447 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 347/699] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:36:08 2022] GET /compute/v2.1/servers/90cd5e2a-127d-4329-93ff-1a8dc66cf049 => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:36:09.856733 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-84bd8bf3-39fa-4371-a650-69655781512c tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1516699062", "imageRef": "ce5a4b61-4265-43de-a33e-a23a4c9f612d", "flavorRef": "452", "networks": [{"uuid": "84b6a1fd-f8a1-4143-b73f-88fe536f65a8"}]}} {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:36:09.908439 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.network.neutron [None req-84bd8bf3-39fa-4371-a650-69655781512c tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] validate_networks() for [('84b6a1fd-f8a1-4143-b73f-88fe536f65a8', None, None, None, None, None)] {{(pid=117988) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 13:36:10.135606 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-3787c3ec-8c11-405b-bd44-aa496302cd87 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:36:10.136219 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-3787c3ec-8c11-405b-bd44-aa496302cd87 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 90cd5e2a-127d-4329-93ff-1a8dc66cf049] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:36:10.142965 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-3787c3ec-8c11-405b-bd44-aa496302cd87 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:10.144075 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-3787c3ec-8c11-405b-bd44-aa496302cd87 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:10.144847 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-3787c3ec-8c11-405b-bd44-aa496302cd87 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:10.145281 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-3787c3ec-8c11-405b-bd44-aa496302cd87 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:10.350328 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.virt.hardware [None req-84bd8bf3-39fa-4371-a650-69655781512c tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Flavor limits 0:0:0 {{(pid=117988) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 13:36:10.350755 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.virt.hardware [None req-84bd8bf3-39fa-4371-a650-69655781512c tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Image limits 0:0:0 {{(pid=117988) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 13:36:10.351218 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.virt.hardware [None req-84bd8bf3-39fa-4371-a650-69655781512c tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Flavor pref 0:0:0 {{(pid=117988) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 13:36:10.351661 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.virt.hardware [None req-84bd8bf3-39fa-4371-a650-69655781512c tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Image pref 0:0:0 {{(pid=117988) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 13:36:10.352064 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.virt.hardware [None req-84bd8bf3-39fa-4371-a650-69655781512c tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117988) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 13:36:10.358000 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-3787c3ec-8c11-405b-bd44-aa496302cd87 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:10.361047 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-84bd8bf3-39fa-4371-a650-69655781512c tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:10.361533 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-84bd8bf3-39fa-4371-a650-69655781512c tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:10.362612 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-84bd8bf3-39fa-4371-a650-69655781512c tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:10.363053 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-84bd8bf3-39fa-4371-a650-69655781512c tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:10.367168 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-3787c3ec-8c11-405b-bd44-aa496302cd87 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:10.368687 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-3787c3ec-8c11-405b-bd44-aa496302cd87 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:10.369909 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-3787c3ec-8c11-405b-bd44-aa496302cd87 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/90cd5e2a-127d-4329-93ff-1a8dc66cf049" status: 200 len: 1722 microversion: 2.20 time: 0.238315 Jul 12 13:36:10.370477 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 348/700] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:36:10 2022] GET /compute/v2.1/servers/90cd5e2a-127d-4329-93ff-1a8dc66cf049 => generated 1722 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 13:36:10.380218 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.quota [None req-84bd8bf3-39fa-4371-a650-69655781512c tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Getting quotas for project a8d960c42bd04476bd6f9b83ae7a2fb6. Resources: {'ram', 'cores', 'instances'} {{(pid=117988) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 13:36:10.384381 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.quota [None req-84bd8bf3-39fa-4371-a650-69655781512c tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Getting quotas for user 9a8c2a9145ac48fd8ddf2f5f76cc6425 and project a8d960c42bd04476bd6f9b83ae7a2fb6. Resources: {'ram', 'cores', 'instances'} {{(pid=117988) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 13:36:10.395765 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-84bd8bf3-39fa-4371-a650-69655781512c tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Going to run 1 instances... {{(pid=117988) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 13:36:10.398037 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-84bd8bf3-39fa-4371-a650-69655781512c tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] [instance: b05effb3-3e31-4364-bcb3-926c5fab42f2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ce5a4b61-4265-43de-a33e-a23a4c9f612d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117988) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 13:36:10.445146 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-84bd8bf3-39fa-4371-a650-69655781512c tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.592124 Jul 12 13:36:10.445824 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 353/701] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 12 13:36:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 593 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 13:36:10.456202 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-cd9425c2-c538-442c-a2b9-0ce8d793c41c tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:36:10.456883 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-cd9425c2-c538-442c-a2b9-0ce8d793c41c tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] [instance: b05effb3-3e31-4364-bcb3-926c5fab42f2] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:36:10.516053 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-cd9425c2-c538-442c-a2b9-0ce8d793c41c tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a8c2a9145ac48fd8ddf2f5f76cc6425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d960c42bd04476bd6f9b83ae7a2fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:10.523857 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-cd9425c2-c538-442c-a2b9-0ce8d793c41c tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] 10.222.0.23 "GET /compute/v2.1/servers/b05effb3-3e31-4364-bcb3-926c5fab42f2" status: 200 len: 1214 microversion: 2.1 time: 0.072076 Jul 12 13:36:10.524429 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 349/702] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:36:10 2022] GET /compute/v2.1/servers/b05effb3-3e31-4364-bcb3-926c5fab42f2 => generated 1214 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:36:11.388956 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-09998903-1aca-4401-b94e-10306a377570 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:36:11.389630 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-09998903-1aca-4401-b94e-10306a377570 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 90cd5e2a-127d-4329-93ff-1a8dc66cf049] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:36:11.396115 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-09998903-1aca-4401-b94e-10306a377570 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:11.396562 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-09998903-1aca-4401-b94e-10306a377570 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:11.397332 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-09998903-1aca-4401-b94e-10306a377570 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:11.397795 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-09998903-1aca-4401-b94e-10306a377570 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:11.534463 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-09998903-1aca-4401-b94e-10306a377570 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:11.540599 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-10a58f56-1cd9-4837-aee9-d211e4b9ff2c tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:36:11.541829 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-10a58f56-1cd9-4837-aee9-d211e4b9ff2c tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] [instance: b05effb3-3e31-4364-bcb3-926c5fab42f2] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:36:11.543259 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-09998903-1aca-4401-b94e-10306a377570 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:11.544782 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-09998903-1aca-4401-b94e-10306a377570 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:11.546021 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-09998903-1aca-4401-b94e-10306a377570 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/90cd5e2a-127d-4329-93ff-1a8dc66cf049" status: 200 len: 1743 microversion: 2.20 time: 0.161803 Jul 12 13:36:11.546831 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 354/703] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:36:11 2022] GET /compute/v2.1/servers/90cd5e2a-127d-4329-93ff-1a8dc66cf049 => generated 1743 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:36:11.549262 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-10a58f56-1cd9-4837-aee9-d211e4b9ff2c tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:11.549770 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-10a58f56-1cd9-4837-aee9-d211e4b9ff2c tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:11.552847 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-10a58f56-1cd9-4837-aee9-d211e4b9ff2c tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:11.552847 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-10a58f56-1cd9-4837-aee9-d211e4b9ff2c tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:11.618238 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-10a58f56-1cd9-4837-aee9-d211e4b9ff2c tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a8c2a9145ac48fd8ddf2f5f76cc6425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d960c42bd04476bd6f9b83ae7a2fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:11.630097 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-10a58f56-1cd9-4837-aee9-d211e4b9ff2c tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] 10.222.0.23 "GET /compute/v2.1/servers/b05effb3-3e31-4364-bcb3-926c5fab42f2" status: 200 len: 1266 microversion: 2.1 time: 0.093173 Jul 12 13:36:11.630741 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 350/704] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:36:11 2022] GET /compute/v2.1/servers/b05effb3-3e31-4364-bcb3-926c5fab42f2 => generated 1266 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:36:12.564037 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-825f3696-8e0b-4d9d-aea9-7085a9dd2985 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:36:12.564658 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-825f3696-8e0b-4d9d-aea9-7085a9dd2985 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 90cd5e2a-127d-4329-93ff-1a8dc66cf049] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:36:12.572601 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-825f3696-8e0b-4d9d-aea9-7085a9dd2985 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:12.573055 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-825f3696-8e0b-4d9d-aea9-7085a9dd2985 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:12.573867 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-825f3696-8e0b-4d9d-aea9-7085a9dd2985 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:12.574309 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-825f3696-8e0b-4d9d-aea9-7085a9dd2985 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:12.647302 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-24f39af9-ba66-481b-8077-bcd938cbdaa6 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:36:12.647913 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-24f39af9-ba66-481b-8077-bcd938cbdaa6 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] [instance: b05effb3-3e31-4364-bcb3-926c5fab42f2] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:36:12.654585 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-24f39af9-ba66-481b-8077-bcd938cbdaa6 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:12.654961 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-24f39af9-ba66-481b-8077-bcd938cbdaa6 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:12.655735 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-24f39af9-ba66-481b-8077-bcd938cbdaa6 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:12.656198 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-24f39af9-ba66-481b-8077-bcd938cbdaa6 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:12.830449 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-825f3696-8e0b-4d9d-aea9-7085a9dd2985 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:12.840111 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-825f3696-8e0b-4d9d-aea9-7085a9dd2985 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:12.841651 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-825f3696-8e0b-4d9d-aea9-7085a9dd2985 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:12.842827 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-825f3696-8e0b-4d9d-aea9-7085a9dd2985 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/90cd5e2a-127d-4329-93ff-1a8dc66cf049" status: 200 len: 1743 microversion: 2.20 time: 0.282732 Jul 12 13:36:12.843398 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 355/705] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:36:12 2022] GET /compute/v2.1/servers/90cd5e2a-127d-4329-93ff-1a8dc66cf049 => generated 1743 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:36:12.894759 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-24f39af9-ba66-481b-8077-bcd938cbdaa6 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a8c2a9145ac48fd8ddf2f5f76cc6425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d960c42bd04476bd6f9b83ae7a2fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:12.902857 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-24f39af9-ba66-481b-8077-bcd938cbdaa6 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] 10.222.0.23 "GET /compute/v2.1/servers/b05effb3-3e31-4364-bcb3-926c5fab42f2" status: 200 len: 1314 microversion: 2.1 time: 0.260204 Jul 12 13:36:12.903443 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 351/706] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:36:12 2022] GET /compute/v2.1/servers/b05effb3-3e31-4364-bcb3-926c5fab42f2 => generated 1314 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:36:13.454410 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [req-f2d8d34b-79e5-4fad-bf00-c3e06fe537b6 req-4559d907-b80b-46fd-92bc-6964b0a319b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b05effb3-3e31-4364-bcb3-926c5fab42f2", "tag": "be25ecb9-1975-4479-ac6d-de0ed37700de"}]} {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:36:13.464602 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [req-f2d8d34b-79e5-4fad-bf00-c3e06fe537b6 req-4559d907-b80b-46fd-92bc-6964b0a319b7 service nova] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:13.465208 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [req-f2d8d34b-79e5-4fad-bf00-c3e06fe537b6 req-4559d907-b80b-46fd-92bc-6964b0a319b7 service nova] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:13.479380 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.compute.server_external_events [req-f2d8d34b-79e5-4fad-bf00-c3e06fe537b6 req-4559d907-b80b-46fd-92bc-6964b0a319b7 service nova] Creating event network-changed:be25ecb9-1975-4479-ac6d-de0ed37700de for instance b05effb3-3e31-4364-bcb3-926c5fab42f2 on hv-cinder-82002 Jul 12 13:36:13.484554 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [req-f2d8d34b-79e5-4fad-bf00-c3e06fe537b6 req-4559d907-b80b-46fd-92bc-6964b0a319b7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033689 Jul 12 13:36:13.485167 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 356/707] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 12 13:36:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:36:13.861497 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-00506c82-e8fa-4ac0-82cf-445961bf89f9 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:36:13.862452 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-00506c82-e8fa-4ac0-82cf-445961bf89f9 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 90cd5e2a-127d-4329-93ff-1a8dc66cf049] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:36:13.870197 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-00506c82-e8fa-4ac0-82cf-445961bf89f9 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:13.871205 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-00506c82-e8fa-4ac0-82cf-445961bf89f9 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:13.872020 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-00506c82-e8fa-4ac0-82cf-445961bf89f9 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:13.872738 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-00506c82-e8fa-4ac0-82cf-445961bf89f9 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:13.920780 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-152237ab-4930-49be-a2b3-7f4d6d814e0e tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:36:13.921665 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-152237ab-4930-49be-a2b3-7f4d6d814e0e tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] [instance: b05effb3-3e31-4364-bcb3-926c5fab42f2] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:36:13.929446 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-152237ab-4930-49be-a2b3-7f4d6d814e0e tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:13.929835 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-152237ab-4930-49be-a2b3-7f4d6d814e0e tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:13.930626 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-152237ab-4930-49be-a2b3-7f4d6d814e0e tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:13.931065 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-152237ab-4930-49be-a2b3-7f4d6d814e0e tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:14.076883 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-00506c82-e8fa-4ac0-82cf-445961bf89f9 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:14.089434 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-00506c82-e8fa-4ac0-82cf-445961bf89f9 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:14.091778 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-00506c82-e8fa-4ac0-82cf-445961bf89f9 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:14.093405 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-00506c82-e8fa-4ac0-82cf-445961bf89f9 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/90cd5e2a-127d-4329-93ff-1a8dc66cf049" status: 200 len: 1743 microversion: 2.20 time: 0.235906 Jul 12 13:36:14.093984 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 352/708] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:36:13 2022] GET /compute/v2.1/servers/90cd5e2a-127d-4329-93ff-1a8dc66cf049 => generated 1743 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:36:14.099333 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [req-150d6e3f-130f-4bbd-ae05-f752236491e3 req-5b7df6d4-f964-49b4-92b9-f5fa78beef8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90cd5e2a-127d-4329-93ff-1a8dc66cf049", "name": "network-vif-plugged", "status": "completed", "tag": "a1218983-36f0-4e25-9df1-d8f2cdfe2972"}]} {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:36:14.107933 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [req-150d6e3f-130f-4bbd-ae05-f752236491e3 req-5b7df6d4-f964-49b4-92b9-f5fa78beef8d service nova] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:14.108456 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [req-150d6e3f-130f-4bbd-ae05-f752236491e3 req-5b7df6d4-f964-49b4-92b9-f5fa78beef8d service nova] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:14.121287 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-152237ab-4930-49be-a2b3-7f4d6d814e0e tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a8c2a9145ac48fd8ddf2f5f76cc6425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d960c42bd04476bd6f9b83ae7a2fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:14.122448 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.compute.server_external_events [req-150d6e3f-130f-4bbd-ae05-f752236491e3 req-5b7df6d4-f964-49b4-92b9-f5fa78beef8d service nova] Creating event network-vif-plugged:a1218983-36f0-4e25-9df1-d8f2cdfe2972 for instance 90cd5e2a-127d-4329-93ff-1a8dc66cf049 on hv-cinder-82002 Jul 12 13:36:14.128253 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [req-150d6e3f-130f-4bbd-ae05-f752236491e3 req-5b7df6d4-f964-49b4-92b9-f5fa78beef8d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032238 Jul 12 13:36:14.128835 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 353/709] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 12 13:36:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:36:14.129640 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-152237ab-4930-49be-a2b3-7f4d6d814e0e tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] 10.222.0.23 "GET /compute/v2.1/servers/b05effb3-3e31-4364-bcb3-926c5fab42f2" status: 200 len: 1314 microversion: 2.1 time: 0.213125 Jul 12 13:36:14.130218 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 357/710] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:36:13 2022] GET /compute/v2.1/servers/b05effb3-3e31-4364-bcb3-926c5fab42f2 => generated 1314 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:36:15.114376 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-b19a5210-ab2e-4e62-a30a-8dd3fbbbf719 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:36:15.115080 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-b19a5210-ab2e-4e62-a30a-8dd3fbbbf719 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 90cd5e2a-127d-4329-93ff-1a8dc66cf049] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:36:15.121527 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-b19a5210-ab2e-4e62-a30a-8dd3fbbbf719 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:15.121980 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-b19a5210-ab2e-4e62-a30a-8dd3fbbbf719 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:15.122755 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-b19a5210-ab2e-4e62-a30a-8dd3fbbbf719 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:15.123188 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-b19a5210-ab2e-4e62-a30a-8dd3fbbbf719 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:15.147218 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-d9e25f58-13cb-43ae-b245-83504c6e325a tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:36:15.147842 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-d9e25f58-13cb-43ae-b245-83504c6e325a tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] [instance: b05effb3-3e31-4364-bcb3-926c5fab42f2] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:36:15.154451 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-d9e25f58-13cb-43ae-b245-83504c6e325a tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:15.154897 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-d9e25f58-13cb-43ae-b245-83504c6e325a tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:15.155669 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-d9e25f58-13cb-43ae-b245-83504c6e325a tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:15.156100 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-d9e25f58-13cb-43ae-b245-83504c6e325a tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:15.325473 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-b19a5210-ab2e-4e62-a30a-8dd3fbbbf719 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:15.334502 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-b19a5210-ab2e-4e62-a30a-8dd3fbbbf719 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:15.336035 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-b19a5210-ab2e-4e62-a30a-8dd3fbbbf719 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:15.337498 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-b19a5210-ab2e-4e62-a30a-8dd3fbbbf719 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/90cd5e2a-127d-4329-93ff-1a8dc66cf049" status: 200 len: 1743 microversion: 2.20 time: 0.229060 Jul 12 13:36:15.338065 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 354/711] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:36:15 2022] GET /compute/v2.1/servers/90cd5e2a-127d-4329-93ff-1a8dc66cf049 => generated 1743 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:36:15.354762 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-d9e25f58-13cb-43ae-b245-83504c6e325a tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a8c2a9145ac48fd8ddf2f5f76cc6425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d960c42bd04476bd6f9b83ae7a2fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:15.363783 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-d9e25f58-13cb-43ae-b245-83504c6e325a tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] 10.222.0.23 "GET /compute/v2.1/servers/b05effb3-3e31-4364-bcb3-926c5fab42f2" status: 200 len: 1314 microversion: 2.1 time: 0.221039 Jul 12 13:36:15.364437 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 358/712] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:36:15 2022] GET /compute/v2.1/servers/b05effb3-3e31-4364-bcb3-926c5fab42f2 => generated 1314 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:36:16.356617 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-d3da84e3-441d-4a9d-a99a-d1cbecead473 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:36:16.357232 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-d3da84e3-441d-4a9d-a99a-d1cbecead473 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 90cd5e2a-127d-4329-93ff-1a8dc66cf049] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:36:16.364324 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-d3da84e3-441d-4a9d-a99a-d1cbecead473 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:16.364762 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-d3da84e3-441d-4a9d-a99a-d1cbecead473 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:16.365568 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-d3da84e3-441d-4a9d-a99a-d1cbecead473 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:16.365994 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-d3da84e3-441d-4a9d-a99a-d1cbecead473 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:16.380809 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-e14165b9-32ad-4fd6-a6c7-7e3003ce69d1 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:36:16.381455 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-e14165b9-32ad-4fd6-a6c7-7e3003ce69d1 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] [instance: b05effb3-3e31-4364-bcb3-926c5fab42f2] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:36:16.387960 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-e14165b9-32ad-4fd6-a6c7-7e3003ce69d1 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:16.388409 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-e14165b9-32ad-4fd6-a6c7-7e3003ce69d1 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:16.389173 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-e14165b9-32ad-4fd6-a6c7-7e3003ce69d1 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:16.389693 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-e14165b9-32ad-4fd6-a6c7-7e3003ce69d1 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:16.569437 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-d3da84e3-441d-4a9d-a99a-d1cbecead473 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:16.577967 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-d3da84e3-441d-4a9d-a99a-d1cbecead473 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:16.579474 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-d3da84e3-441d-4a9d-a99a-d1cbecead473 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:16.581488 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-d3da84e3-441d-4a9d-a99a-d1cbecead473 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/90cd5e2a-127d-4329-93ff-1a8dc66cf049" status: 200 len: 1743 microversion: 2.20 time: 0.228133 Jul 12 13:36:16.582140 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-e14165b9-32ad-4fd6-a6c7-7e3003ce69d1 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a8c2a9145ac48fd8ddf2f5f76cc6425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d960c42bd04476bd6f9b83ae7a2fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:16.582340 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 355/713] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:36:16 2022] GET /compute/v2.1/servers/90cd5e2a-127d-4329-93ff-1a8dc66cf049 => generated 1743 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:36:16.590364 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-e14165b9-32ad-4fd6-a6c7-7e3003ce69d1 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] 10.222.0.23 "GET /compute/v2.1/servers/b05effb3-3e31-4364-bcb3-926c5fab42f2" status: 200 len: 1314 microversion: 2.1 time: 0.214114 Jul 12 13:36:16.590956 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 359/714] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:36:16 2022] GET /compute/v2.1/servers/b05effb3-3e31-4364-bcb3-926c5fab42f2 => generated 1314 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:36:17.601771 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-7b751011-4b33-423f-b4cd-9532bf7a218a tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:36:17.602403 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-7b751011-4b33-423f-b4cd-9532bf7a218a tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 90cd5e2a-127d-4329-93ff-1a8dc66cf049] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:36:17.607706 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-271b31eb-04d5-42c7-80cf-2e780c53c8fd tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:36:17.608326 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-271b31eb-04d5-42c7-80cf-2e780c53c8fd tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] [instance: b05effb3-3e31-4364-bcb3-926c5fab42f2] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:36:17.608987 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-7b751011-4b33-423f-b4cd-9532bf7a218a tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:17.609457 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-7b751011-4b33-423f-b4cd-9532bf7a218a tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:17.610228 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-7b751011-4b33-423f-b4cd-9532bf7a218a tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:17.610655 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-7b751011-4b33-423f-b4cd-9532bf7a218a tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:17.617983 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-271b31eb-04d5-42c7-80cf-2e780c53c8fd tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:17.618449 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-271b31eb-04d5-42c7-80cf-2e780c53c8fd tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:17.619223 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-271b31eb-04d5-42c7-80cf-2e780c53c8fd tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:17.619713 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-271b31eb-04d5-42c7-80cf-2e780c53c8fd tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:17.825145 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-7b751011-4b33-423f-b4cd-9532bf7a218a tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:17.834594 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-7b751011-4b33-423f-b4cd-9532bf7a218a tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:17.835294 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-271b31eb-04d5-42c7-80cf-2e780c53c8fd tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a8c2a9145ac48fd8ddf2f5f76cc6425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d960c42bd04476bd6f9b83ae7a2fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:17.836106 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-7b751011-4b33-423f-b4cd-9532bf7a218a tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:17.844940 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-7b751011-4b33-423f-b4cd-9532bf7a218a tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/90cd5e2a-127d-4329-93ff-1a8dc66cf049" status: 200 len: 1743 microversion: 2.20 time: 0.240509 Jul 12 13:36:17.853198 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-271b31eb-04d5-42c7-80cf-2e780c53c8fd tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] 10.222.0.23 "GET /compute/v2.1/servers/b05effb3-3e31-4364-bcb3-926c5fab42f2" status: 200 len: 1314 microversion: 2.1 time: 0.248851 Jul 12 13:36:17.853890 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 360/715] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:36:17 2022] GET /compute/v2.1/servers/b05effb3-3e31-4364-bcb3-926c5fab42f2 => generated 1314 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:36:17.862897 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 356/716] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:36:17 2022] GET /compute/v2.1/servers/90cd5e2a-127d-4329-93ff-1a8dc66cf049 => generated 1743 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:36:18.868709 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-1f87a420-72bd-437e-bb4c-4671d4ad5852 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:36:18.869318 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-1f87a420-72bd-437e-bb4c-4671d4ad5852 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 90cd5e2a-127d-4329-93ff-1a8dc66cf049] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:36:18.871988 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-30efb558-8696-4ad5-b43b-4abae5d818cd tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:36:18.872661 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-30efb558-8696-4ad5-b43b-4abae5d818cd tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] [instance: b05effb3-3e31-4364-bcb3-926c5fab42f2] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:36:18.876269 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-1f87a420-72bd-437e-bb4c-4671d4ad5852 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:18.876542 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-1f87a420-72bd-437e-bb4c-4671d4ad5852 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:18.878170 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-1f87a420-72bd-437e-bb4c-4671d4ad5852 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:18.878554 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-1f87a420-72bd-437e-bb4c-4671d4ad5852 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:18.880441 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-30efb558-8696-4ad5-b43b-4abae5d818cd tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:18.881108 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-30efb558-8696-4ad5-b43b-4abae5d818cd tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:18.882249 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-30efb558-8696-4ad5-b43b-4abae5d818cd tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:18.882396 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-30efb558-8696-4ad5-b43b-4abae5d818cd tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:19.098563 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-30efb558-8696-4ad5-b43b-4abae5d818cd tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a8c2a9145ac48fd8ddf2f5f76cc6425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d960c42bd04476bd6f9b83ae7a2fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:19.099918 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-1f87a420-72bd-437e-bb4c-4671d4ad5852 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:19.105606 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG dbcounter [-] [117988] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117988) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:36:19.106456 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-30efb558-8696-4ad5-b43b-4abae5d818cd tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] 10.222.0.23 "GET /compute/v2.1/servers/b05effb3-3e31-4364-bcb3-926c5fab42f2" status: 200 len: 1314 microversion: 2.1 time: 0.238272 Jul 12 13:36:19.107377 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 357/717] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:36:18 2022] GET /compute/v2.1/servers/b05effb3-3e31-4364-bcb3-926c5fab42f2 => generated 1314 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:36:19.115097 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-1f87a420-72bd-437e-bb4c-4671d4ad5852 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:19.116690 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-1f87a420-72bd-437e-bb4c-4671d4ad5852 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:19.118249 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-1f87a420-72bd-437e-bb4c-4671d4ad5852 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/90cd5e2a-127d-4329-93ff-1a8dc66cf049" status: 200 len: 1738 microversion: 2.20 time: 0.254104 Jul 12 13:36:19.118812 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 361/718] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:36:18 2022] GET /compute/v2.1/servers/90cd5e2a-127d-4329-93ff-1a8dc66cf049 => generated 1738 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:36:19.805729 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-302c6b1d-8ca0-44b6-8137-6daacfa9f0cb tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:36:19.806229 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-302c6b1d-8ca0-44b6-8137-6daacfa9f0cb tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] [instance: a4c23b11-fc12-4dd8-8a9c-9019f9e101c9] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:36:19.812745 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-302c6b1d-8ca0-44b6-8137-6daacfa9f0cb tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:19.813550 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-302c6b1d-8ca0-44b6-8137-6daacfa9f0cb tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:19.814794 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-302c6b1d-8ca0-44b6-8137-6daacfa9f0cb tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:19.816549 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-302c6b1d-8ca0-44b6-8137-6daacfa9f0cb tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:19.849140 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG dbcounter [-] [117987] Writing DB stats nova_cell1:SELECT=100 {{(pid=117987) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:36:19.856826 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [req-e716687a-8079-44f3-a0ba-7330db21e9a2 req-da13aed3-983c-4e3f-96bd-1e7403958197 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b05effb3-3e31-4364-bcb3-926c5fab42f2", "name": "network-vif-plugged", "status": "completed", "tag": "be25ecb9-1975-4479-ac6d-de0ed37700de"}]} {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:36:19.866933 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-302c6b1d-8ca0-44b6-8137-6daacfa9f0cb tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] 10.222.0.23 "GET /compute/v2.1/servers/a4c23b11-fc12-4dd8-8a9c-9019f9e101c9/ips" status: 200 len: 146 microversion: 2.1 time: 0.065609 Jul 12 13:36:19.874346 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 358/719] 10.222.0.23 () {58 vars in 1247 bytes} [Tue Jul 12 13:36:19 2022] GET /compute/v2.1/servers/a4c23b11-fc12-4dd8-8a9c-9019f9e101c9/ips => generated 146 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:36:19.876361 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [req-e716687a-8079-44f3-a0ba-7330db21e9a2 req-da13aed3-983c-4e3f-96bd-1e7403958197 service nova] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:19.876812 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [req-e716687a-8079-44f3-a0ba-7330db21e9a2 req-da13aed3-983c-4e3f-96bd-1e7403958197 service nova] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:19.891239 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.compute.server_external_events [req-e716687a-8079-44f3-a0ba-7330db21e9a2 req-da13aed3-983c-4e3f-96bd-1e7403958197 service nova] Creating event network-vif-plugged:be25ecb9-1975-4479-ac6d-de0ed37700de for instance b05effb3-3e31-4364-bcb3-926c5fab42f2 on hv-cinder-82002 Jul 12 13:36:19.898513 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [req-e716687a-8079-44f3-a0ba-7330db21e9a2 req-da13aed3-983c-4e3f-96bd-1e7403958197 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045218 Jul 12 13:36:19.899556 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 362/720] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 12 13:36:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:36:20.124891 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-2fbacf2b-fc56-4725-bfe4-c00f3180c792 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:36:20.126137 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-2fbacf2b-fc56-4725-bfe4-c00f3180c792 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] [instance: b05effb3-3e31-4364-bcb3-926c5fab42f2] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:36:20.138176 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-2fbacf2b-fc56-4725-bfe4-c00f3180c792 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:20.138906 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-2fbacf2b-fc56-4725-bfe4-c00f3180c792 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:20.139549 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-95c3b0c4-4e25-43be-8c66-af9e08b725d9 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:36:20.141327 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-95c3b0c4-4e25-43be-8c66-af9e08b725d9 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 90cd5e2a-127d-4329-93ff-1a8dc66cf049] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:36:20.141807 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-2fbacf2b-fc56-4725-bfe4-c00f3180c792 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:20.142439 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-2fbacf2b-fc56-4725-bfe4-c00f3180c792 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:20.155719 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-95c3b0c4-4e25-43be-8c66-af9e08b725d9 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:20.156215 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-95c3b0c4-4e25-43be-8c66-af9e08b725d9 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:20.157030 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-95c3b0c4-4e25-43be-8c66-af9e08b725d9 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:20.157489 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-95c3b0c4-4e25-43be-8c66-af9e08b725d9 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:20.370636 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG dbcounter [-] [117988] Writing DB stats nova_cell0:SELECT=2 {{(pid=117988) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:36:20.391294 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG dbcounter [-] [117988] Writing DB stats nova_cell0:SELECT=6 {{(pid=117988) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:36:20.521800 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG dbcounter [-] [117987] Writing DB stats nova_cell0:SELECT=2 {{(pid=117987) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:36:20.528555 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-2fbacf2b-fc56-4725-bfe4-c00f3180c792 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a8c2a9145ac48fd8ddf2f5f76cc6425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d960c42bd04476bd6f9b83ae7a2fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:20.533985 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-95c3b0c4-4e25-43be-8c66-af9e08b725d9 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:20.538659 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-2fbacf2b-fc56-4725-bfe4-c00f3180c792 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] 10.222.0.23 "GET /compute/v2.1/servers/b05effb3-3e31-4364-bcb3-926c5fab42f2" status: 200 len: 1314 microversion: 2.1 time: 0.418224 Jul 12 13:36:20.548295 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-95c3b0c4-4e25-43be-8c66-af9e08b725d9 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:20.548772 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 359/721] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:36:20 2022] GET /compute/v2.1/servers/b05effb3-3e31-4364-bcb3-926c5fab42f2 => generated 1314 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:36:20.554297 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-95c3b0c4-4e25-43be-8c66-af9e08b725d9 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:20.556108 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-95c3b0c4-4e25-43be-8c66-af9e08b725d9 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/90cd5e2a-127d-4329-93ff-1a8dc66cf049" status: 200 len: 1738 microversion: 2.20 time: 0.422026 Jul 12 13:36:20.558197 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 363/722] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:36:20 2022] GET /compute/v2.1/servers/90cd5e2a-127d-4329-93ff-1a8dc66cf049 => generated 1738 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 13:36:21.421729 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-e9332d05-2708-4213-92f7-de6ede47cec9 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6d03df11-b3f3-463a-94cb-abf81670da9a"}} {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:36:21.423494 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-e9332d05-2708-4213-92f7-de6ede47cec9 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] [instance: a4c23b11-fc12-4dd8-8a9c-9019f9e101c9] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:36:21.432122 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-e9332d05-2708-4213-92f7-de6ede47cec9 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:21.432832 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-e9332d05-2708-4213-92f7-de6ede47cec9 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:21.433818 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-e9332d05-2708-4213-92f7-de6ede47cec9 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:21.434428 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-e9332d05-2708-4213-92f7-de6ede47cec9 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:21.557206 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-343abe5e-f766-4597-895e-314488f0dde3 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:36:21.558512 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-343abe5e-f766-4597-895e-314488f0dde3 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] [instance: b05effb3-3e31-4364-bcb3-926c5fab42f2] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:36:21.565928 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-343abe5e-f766-4597-895e-314488f0dde3 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:21.567536 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-343abe5e-f766-4597-895e-314488f0dde3 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:21.568526 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-343abe5e-f766-4597-895e-314488f0dde3 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:21.569132 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-343abe5e-f766-4597-895e-314488f0dde3 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:21.814456 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-343abe5e-f766-4597-895e-314488f0dde3 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a8c2a9145ac48fd8ddf2f5f76cc6425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d960c42bd04476bd6f9b83ae7a2fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:21.831236 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-343abe5e-f766-4597-895e-314488f0dde3 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] 10.222.0.23 "GET /compute/v2.1/servers/b05effb3-3e31-4364-bcb3-926c5fab42f2" status: 200 len: 1314 microversion: 2.1 time: 0.276839 Jul 12 13:36:21.846293 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 364/723] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:36:21 2022] GET /compute/v2.1/servers/b05effb3-3e31-4364-bcb3-926c5fab42f2 => generated 1314 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:36:21.853215 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-e9332d05-2708-4213-92f7-de6ede47cec9 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] 10.222.0.23 "POST /compute/v2.1/servers/a4c23b11-fc12-4dd8-8a9c-9019f9e101c9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.435689 Jul 12 13:36:21.858667 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 360/724] 10.222.0.23 () {60 vars in 1322 bytes} [Tue Jul 12 13:36:21 2022] POST /compute/v2.1/servers/a4c23b11-fc12-4dd8-8a9c-9019f9e101c9/os-volume_attachments => generated 194 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:36:21.862633 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-c999ed1f-62d5-4036-975d-a89529c44293 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:36:21.863483 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-c999ed1f-62d5-4036-975d-a89529c44293 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 90cd5e2a-127d-4329-93ff-1a8dc66cf049] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:36:21.870351 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-c999ed1f-62d5-4036-975d-a89529c44293 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:21.871023 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-c999ed1f-62d5-4036-975d-a89529c44293 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:21.871996 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-c999ed1f-62d5-4036-975d-a89529c44293 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:21.872594 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-c999ed1f-62d5-4036-975d-a89529c44293 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:22.062050 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-c999ed1f-62d5-4036-975d-a89529c44293 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:22.074559 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-c999ed1f-62d5-4036-975d-a89529c44293 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:22.076374 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-c999ed1f-62d5-4036-975d-a89529c44293 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:22.077599 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-c999ed1f-62d5-4036-975d-a89529c44293 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/90cd5e2a-127d-4329-93ff-1a8dc66cf049" status: 200 len: 1738 microversion: 2.20 time: 0.229268 Jul 12 13:36:22.078328 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 365/725] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:36:21 2022] GET /compute/v2.1/servers/90cd5e2a-127d-4329-93ff-1a8dc66cf049 => generated 1738 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:36:22.860101 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-eedddbc3-5e40-4cd6-ba30-34cd2dd7e9c4 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:36:22.861781 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-eedddbc3-5e40-4cd6-ba30-34cd2dd7e9c4 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] [instance: b05effb3-3e31-4364-bcb3-926c5fab42f2] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:36:22.865042 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG dbcounter [-] [117987] Writing DB stats nova_api:SELECT=45 {{(pid=117987) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:36:22.872408 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-eedddbc3-5e40-4cd6-ba30-34cd2dd7e9c4 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:22.873043 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-eedddbc3-5e40-4cd6-ba30-34cd2dd7e9c4 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:22.874007 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-eedddbc3-5e40-4cd6-ba30-34cd2dd7e9c4 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:22.874691 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-eedddbc3-5e40-4cd6-ba30-34cd2dd7e9c4 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:23.088791 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-eedddbc3-5e40-4cd6-ba30-34cd2dd7e9c4 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a8c2a9145ac48fd8ddf2f5f76cc6425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d960c42bd04476bd6f9b83ae7a2fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:23.098823 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-504e0cfc-2925-43b9-924a-1948fa4c0890 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:36:23.100052 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-504e0cfc-2925-43b9-924a-1948fa4c0890 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 90cd5e2a-127d-4329-93ff-1a8dc66cf049] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:36:23.102250 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-eedddbc3-5e40-4cd6-ba30-34cd2dd7e9c4 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] 10.222.0.23 "GET /compute/v2.1/servers/b05effb3-3e31-4364-bcb3-926c5fab42f2" status: 200 len: 1497 microversion: 2.1 time: 0.247493 Jul 12 13:36:23.107881 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-504e0cfc-2925-43b9-924a-1948fa4c0890 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:23.108790 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-504e0cfc-2925-43b9-924a-1948fa4c0890 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:23.109791 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-504e0cfc-2925-43b9-924a-1948fa4c0890 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:23.110450 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-504e0cfc-2925-43b9-924a-1948fa4c0890 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:23.115120 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 361/726] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:36:22 2022] GET /compute/v2.1/servers/b05effb3-3e31-4364-bcb3-926c5fab42f2 => generated 1497 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:36:23.297940 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-504e0cfc-2925-43b9-924a-1948fa4c0890 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:23.307355 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-504e0cfc-2925-43b9-924a-1948fa4c0890 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:23.309659 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-504e0cfc-2925-43b9-924a-1948fa4c0890 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:23.311194 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-504e0cfc-2925-43b9-924a-1948fa4c0890 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/90cd5e2a-127d-4329-93ff-1a8dc66cf049" status: 200 len: 1738 microversion: 2.20 time: 0.216592 Jul 12 13:36:23.312148 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 366/727] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:36:23 2022] GET /compute/v2.1/servers/90cd5e2a-127d-4329-93ff-1a8dc66cf049 => generated 1738 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 13:36:23.722298 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-a648b064-9855-4943-95ae-8a7f3dce1240 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:36:23.722906 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-a648b064-9855-4943-95ae-8a7f3dce1240 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] [instance: b05effb3-3e31-4364-bcb3-926c5fab42f2] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:36:23.731734 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-a648b064-9855-4943-95ae-8a7f3dce1240 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:23.732366 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-a648b064-9855-4943-95ae-8a7f3dce1240 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:23.733144 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-a648b064-9855-4943-95ae-8a7f3dce1240 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:23.733682 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-a648b064-9855-4943-95ae-8a7f3dce1240 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:23.766113 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-a648b064-9855-4943-95ae-8a7f3dce1240 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] [instance: b05effb3-3e31-4364-bcb3-926c5fab42f2] Going to try to terminate instance {{(pid=117987) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 13:36:23.870800 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-a648b064-9855-4943-95ae-8a7f3dce1240 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] 10.222.0.23 "DELETE /compute/v2.1/servers/b05effb3-3e31-4364-bcb3-926c5fab42f2" status: 204 len: 0 microversion: 2.1 time: 0.151879 Jul 12 13:36:23.873931 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 362/728] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 12 13:36:23 2022] DELETE /compute/v2.1/servers/b05effb3-3e31-4364-bcb3-926c5fab42f2 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 13:36:23.884480 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-b86fc210-fc6d-422d-a559-8cb4a6163a14 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:36:23.885674 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-b86fc210-fc6d-422d-a559-8cb4a6163a14 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] [instance: b05effb3-3e31-4364-bcb3-926c5fab42f2] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:36:23.892244 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-b86fc210-fc6d-422d-a559-8cb4a6163a14 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:23.892614 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-b86fc210-fc6d-422d-a559-8cb4a6163a14 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:23.894037 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-b86fc210-fc6d-422d-a559-8cb4a6163a14 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:23.894489 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-b86fc210-fc6d-422d-a559-8cb4a6163a14 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:24.098091 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-b86fc210-fc6d-422d-a559-8cb4a6163a14 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a8c2a9145ac48fd8ddf2f5f76cc6425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d960c42bd04476bd6f9b83ae7a2fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:24.107191 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-b86fc210-fc6d-422d-a559-8cb4a6163a14 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] 10.222.0.23 "GET /compute/v2.1/servers/b05effb3-3e31-4364-bcb3-926c5fab42f2" status: 200 len: 1503 microversion: 2.1 time: 0.226876 Jul 12 13:36:24.108166 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 367/729] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:36:23 2022] GET /compute/v2.1/servers/b05effb3-3e31-4364-bcb3-926c5fab42f2 => generated 1503 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:36:24.334154 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-4137e703-7020-4bc0-bd90-46f02dc2a307 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:36:24.334608 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-4137e703-7020-4bc0-bd90-46f02dc2a307 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 90cd5e2a-127d-4329-93ff-1a8dc66cf049] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:36:24.341214 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-4137e703-7020-4bc0-bd90-46f02dc2a307 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:24.342058 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-4137e703-7020-4bc0-bd90-46f02dc2a307 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:24.342757 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-4137e703-7020-4bc0-bd90-46f02dc2a307 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:24.343189 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-4137e703-7020-4bc0-bd90-46f02dc2a307 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:24.499641 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-4137e703-7020-4bc0-bd90-46f02dc2a307 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:24.514182 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-4137e703-7020-4bc0-bd90-46f02dc2a307 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:24.516020 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-4137e703-7020-4bc0-bd90-46f02dc2a307 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:24.517222 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-4137e703-7020-4bc0-bd90-46f02dc2a307 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/90cd5e2a-127d-4329-93ff-1a8dc66cf049" status: 200 len: 1738 microversion: 2.20 time: 0.189120 Jul 12 13:36:24.525596 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 363/730] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:36:24 2022] GET /compute/v2.1/servers/90cd5e2a-127d-4329-93ff-1a8dc66cf049 => generated 1738 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:36:25.124582 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-ab04db36-2b13-4eee-9e2d-45b99fcc0fdf tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:36:25.126007 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-ab04db36-2b13-4eee-9e2d-45b99fcc0fdf tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] [instance: b05effb3-3e31-4364-bcb3-926c5fab42f2] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:36:25.129345 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG dbcounter [-] [117988] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=3 {{(pid=117988) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:36:25.135370 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-ab04db36-2b13-4eee-9e2d-45b99fcc0fdf tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:25.136163 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-ab04db36-2b13-4eee-9e2d-45b99fcc0fdf tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:25.137593 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-ab04db36-2b13-4eee-9e2d-45b99fcc0fdf tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:25.137916 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-ab04db36-2b13-4eee-9e2d-45b99fcc0fdf tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:25.298540 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-ab04db36-2b13-4eee-9e2d-45b99fcc0fdf tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a8c2a9145ac48fd8ddf2f5f76cc6425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d960c42bd04476bd6f9b83ae7a2fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:25.307732 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-ab04db36-2b13-4eee-9e2d-45b99fcc0fdf tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] 10.222.0.23 "GET /compute/v2.1/servers/b05effb3-3e31-4364-bcb3-926c5fab42f2" status: 200 len: 1503 microversion: 2.1 time: 0.187007 Jul 12 13:36:25.308330 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 368/731] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:36:25 2022] GET /compute/v2.1/servers/b05effb3-3e31-4364-bcb3-926c5fab42f2 => generated 1503 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:36:25.347161 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-ab3817e5-e5f7-4eed-843c-6a4a2631cbcf tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:36:25.347834 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-ab3817e5-e5f7-4eed-843c-6a4a2631cbcf tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] [instance: a950219a-3350-49e1-ac49-2da471d9b327] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:36:25.354936 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-ab3817e5-e5f7-4eed-843c-6a4a2631cbcf tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:25.355659 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-ab3817e5-e5f7-4eed-843c-6a4a2631cbcf tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:25.356448 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-ab3817e5-e5f7-4eed-843c-6a4a2631cbcf tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:25.356913 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-ab3817e5-e5f7-4eed-843c-6a4a2631cbcf tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:25.384922 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-ab3817e5-e5f7-4eed-843c-6a4a2631cbcf tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] [instance: a950219a-3350-49e1-ac49-2da471d9b327] Going to try to terminate instance {{(pid=117987) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 13:36:25.473469 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-ab3817e5-e5f7-4eed-843c-6a4a2631cbcf tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] 10.222.0.23 "DELETE /compute/v2.1/servers/a950219a-3350-49e1-ac49-2da471d9b327" status: 204 len: 0 microversion: 2.1 time: 0.130132 Jul 12 13:36:25.474111 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 364/732] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 12 13:36:25 2022] DELETE /compute/v2.1/servers/a950219a-3350-49e1-ac49-2da471d9b327 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 13:36:25.482143 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-3fb8c767-0972-46e2-9e5f-f0966e70222d tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:36:25.482758 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-3fb8c767-0972-46e2-9e5f-f0966e70222d tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] [instance: a950219a-3350-49e1-ac49-2da471d9b327] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:36:25.489539 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-3fb8c767-0972-46e2-9e5f-f0966e70222d tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:25.489993 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-3fb8c767-0972-46e2-9e5f-f0966e70222d tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:25.490769 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-3fb8c767-0972-46e2-9e5f-f0966e70222d tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:25.491206 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-3fb8c767-0972-46e2-9e5f-f0966e70222d tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:25.542415 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-dd0b28fb-4cdc-4614-ad74-244ce687f907 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:36:25.543889 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-dd0b28fb-4cdc-4614-ad74-244ce687f907 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 90cd5e2a-127d-4329-93ff-1a8dc66cf049] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:36:25.554306 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-dd0b28fb-4cdc-4614-ad74-244ce687f907 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:25.555249 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-dd0b28fb-4cdc-4614-ad74-244ce687f907 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:25.556170 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-dd0b28fb-4cdc-4614-ad74-244ce687f907 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:25.556692 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-dd0b28fb-4cdc-4614-ad74-244ce687f907 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:25.768907 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-3fb8c767-0972-46e2-9e5f-f0966e70222d tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa0b8a0b7ff4eb0b13fb985dc0d710a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3897c86b8c847ea9091f3c7ad344fa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:25.787667 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-3fb8c767-0972-46e2-9e5f-f0966e70222d tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] 10.222.0.23 "GET /compute/v2.1/servers/a950219a-3350-49e1-ac49-2da471d9b327" status: 200 len: 1576 microversion: 2.1 time: 0.309215 Jul 12 13:36:25.788284 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 369/733] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:36:25 2022] GET /compute/v2.1/servers/a950219a-3350-49e1-ac49-2da471d9b327 => generated 1576 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:36:25.846563 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-dd0b28fb-4cdc-4614-ad74-244ce687f907 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:25.855126 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-dd0b28fb-4cdc-4614-ad74-244ce687f907 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:25.856668 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-dd0b28fb-4cdc-4614-ad74-244ce687f907 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:25.857858 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-dd0b28fb-4cdc-4614-ad74-244ce687f907 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/90cd5e2a-127d-4329-93ff-1a8dc66cf049" status: 200 len: 1738 microversion: 2.20 time: 0.324549 Jul 12 13:36:25.858431 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 365/734] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:36:25 2022] GET /compute/v2.1/servers/90cd5e2a-127d-4329-93ff-1a8dc66cf049 => generated 1738 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:36:26.326994 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-0599f2df-b275-4ad3-991e-c90b16623024 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:36:26.328734 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-0599f2df-b275-4ad3-991e-c90b16623024 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] [instance: b05effb3-3e31-4364-bcb3-926c5fab42f2] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:36:26.336980 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-0599f2df-b275-4ad3-991e-c90b16623024 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:26.337815 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-0599f2df-b275-4ad3-991e-c90b16623024 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:26.338747 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-0599f2df-b275-4ad3-991e-c90b16623024 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:26.339188 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-0599f2df-b275-4ad3-991e-c90b16623024 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:26.508274 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-0599f2df-b275-4ad3-991e-c90b16623024 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a8c2a9145ac48fd8ddf2f5f76cc6425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d960c42bd04476bd6f9b83ae7a2fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:26.516863 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-0599f2df-b275-4ad3-991e-c90b16623024 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] 10.222.0.23 "GET /compute/v2.1/servers/b05effb3-3e31-4364-bcb3-926c5fab42f2" status: 200 len: 1503 microversion: 2.1 time: 0.194446 Jul 12 13:36:26.526286 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 370/735] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:36:26 2022] GET /compute/v2.1/servers/b05effb3-3e31-4364-bcb3-926c5fab42f2 => generated 1503 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:36:26.807546 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-4d8e2df4-e19d-4eb0-a162-c9017f36bef1 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:36:26.808142 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-4d8e2df4-e19d-4eb0-a162-c9017f36bef1 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] [instance: a950219a-3350-49e1-ac49-2da471d9b327] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:36:26.815624 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-4d8e2df4-e19d-4eb0-a162-c9017f36bef1 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:26.816406 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-4d8e2df4-e19d-4eb0-a162-c9017f36bef1 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:26.817975 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-4d8e2df4-e19d-4eb0-a162-c9017f36bef1 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:26.818662 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-4d8e2df4-e19d-4eb0-a162-c9017f36bef1 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:26.876311 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-371c40cc-4309-4582-8928-fe666d5c120f tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:36:26.878014 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-371c40cc-4309-4582-8928-fe666d5c120f tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 90cd5e2a-127d-4329-93ff-1a8dc66cf049] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:36:26.886681 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-371c40cc-4309-4582-8928-fe666d5c120f tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:26.888182 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-371c40cc-4309-4582-8928-fe666d5c120f tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:26.889231 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-371c40cc-4309-4582-8928-fe666d5c120f tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:26.889931 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-371c40cc-4309-4582-8928-fe666d5c120f tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:27.152336 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-4d8e2df4-e19d-4eb0-a162-c9017f36bef1 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa0b8a0b7ff4eb0b13fb985dc0d710a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3897c86b8c847ea9091f3c7ad344fa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:27.163298 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-4d8e2df4-e19d-4eb0-a162-c9017f36bef1 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] 10.222.0.23 "GET /compute/v2.1/servers/a950219a-3350-49e1-ac49-2da471d9b327" status: 200 len: 1576 microversion: 2.1 time: 0.361327 Jul 12 13:36:27.164532 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 366/736] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:36:26 2022] GET /compute/v2.1/servers/a950219a-3350-49e1-ac49-2da471d9b327 => generated 1576 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:36:27.228050 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-371c40cc-4309-4582-8928-fe666d5c120f tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:27.245564 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-371c40cc-4309-4582-8928-fe666d5c120f tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:27.247620 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-371c40cc-4309-4582-8928-fe666d5c120f tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:27.249183 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-371c40cc-4309-4582-8928-fe666d5c120f tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/90cd5e2a-127d-4329-93ff-1a8dc66cf049" status: 200 len: 1738 microversion: 2.20 time: 0.376927 Jul 12 13:36:27.261368 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 371/737] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:36:26 2022] GET /compute/v2.1/servers/90cd5e2a-127d-4329-93ff-1a8dc66cf049 => generated 1738 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:36:27.535896 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-143e4c26-ca53-486b-b36f-150a7eca49e5 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:36:27.536423 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-143e4c26-ca53-486b-b36f-150a7eca49e5 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] [instance: b05effb3-3e31-4364-bcb3-926c5fab42f2] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:36:27.546107 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-143e4c26-ca53-486b-b36f-150a7eca49e5 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:27.546556 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-143e4c26-ca53-486b-b36f-150a7eca49e5 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:27.547402 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-143e4c26-ca53-486b-b36f-150a7eca49e5 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:27.547761 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-143e4c26-ca53-486b-b36f-150a7eca49e5 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:27.563451 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [req-f9ebe8d9-d16b-4412-b036-76bb434c2c16 req-efb9d6b2-a3a7-4613-862c-12a085f8c7bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b05effb3-3e31-4364-bcb3-926c5fab42f2", "name": "network-vif-deleted", "tag": "be25ecb9-1975-4479-ac6d-de0ed37700de"}]} {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:36:27.577468 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [req-f9ebe8d9-d16b-4412-b036-76bb434c2c16 req-efb9d6b2-a3a7-4613-862c-12a085f8c7bd service nova] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:27.578416 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [req-f9ebe8d9-d16b-4412-b036-76bb434c2c16 req-efb9d6b2-a3a7-4613-862c-12a085f8c7bd service nova] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:27.600382 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.compute.server_external_events [req-f9ebe8d9-d16b-4412-b036-76bb434c2c16 req-efb9d6b2-a3a7-4613-862c-12a085f8c7bd service nova] Creating event network-vif-deleted:be25ecb9-1975-4479-ac6d-de0ed37700de for instance b05effb3-3e31-4364-bcb3-926c5fab42f2 on hv-cinder-82002 Jul 12 13:36:27.606694 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [req-f9ebe8d9-d16b-4412-b036-76bb434c2c16 req-efb9d6b2-a3a7-4613-862c-12a085f8c7bd service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048866 Jul 12 13:36:27.610150 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 372/738] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 12 13:36:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:36:27.671258 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-143e4c26-ca53-486b-b36f-150a7eca49e5 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a8c2a9145ac48fd8ddf2f5f76cc6425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d960c42bd04476bd6f9b83ae7a2fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:27.680220 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-143e4c26-ca53-486b-b36f-150a7eca49e5 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] 10.222.0.23 "GET /compute/v2.1/servers/b05effb3-3e31-4364-bcb3-926c5fab42f2" status: 200 len: 1461 microversion: 2.1 time: 0.149426 Jul 12 13:36:27.681077 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 367/739] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:36:27 2022] GET /compute/v2.1/servers/b05effb3-3e31-4364-bcb3-926c5fab42f2 => generated 1461 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:36:28.184084 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-884ac617-17be-49d8-a9c9-8d96d7f86f8d tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:36:28.185053 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-884ac617-17be-49d8-a9c9-8d96d7f86f8d tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] [instance: a950219a-3350-49e1-ac49-2da471d9b327] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:36:28.194241 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-884ac617-17be-49d8-a9c9-8d96d7f86f8d tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:28.194989 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-884ac617-17be-49d8-a9c9-8d96d7f86f8d tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:28.195958 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-884ac617-17be-49d8-a9c9-8d96d7f86f8d tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:28.196597 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-884ac617-17be-49d8-a9c9-8d96d7f86f8d tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:28.273907 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-6f10daa7-42a2-4b47-9ce9-b701801cf974 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:36:28.274951 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-6f10daa7-42a2-4b47-9ce9-b701801cf974 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 90cd5e2a-127d-4329-93ff-1a8dc66cf049] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:36:28.289974 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-6f10daa7-42a2-4b47-9ce9-b701801cf974 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:28.290909 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-6f10daa7-42a2-4b47-9ce9-b701801cf974 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:28.291712 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-6f10daa7-42a2-4b47-9ce9-b701801cf974 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:28.292157 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-6f10daa7-42a2-4b47-9ce9-b701801cf974 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:28.447900 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-884ac617-17be-49d8-a9c9-8d96d7f86f8d tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa0b8a0b7ff4eb0b13fb985dc0d710a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3897c86b8c847ea9091f3c7ad344fa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:28.456227 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-884ac617-17be-49d8-a9c9-8d96d7f86f8d tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] 10.222.0.23 "GET /compute/v2.1/servers/a950219a-3350-49e1-ac49-2da471d9b327" status: 200 len: 1576 microversion: 2.1 time: 0.275879 Jul 12 13:36:28.456817 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 373/740] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:36:28 2022] GET /compute/v2.1/servers/a950219a-3350-49e1-ac49-2da471d9b327 => generated 1576 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:36:28.517006 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-6f10daa7-42a2-4b47-9ce9-b701801cf974 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:28.528420 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-6f10daa7-42a2-4b47-9ce9-b701801cf974 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:28.530458 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-6f10daa7-42a2-4b47-9ce9-b701801cf974 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:28.531945 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-6f10daa7-42a2-4b47-9ce9-b701801cf974 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/90cd5e2a-127d-4329-93ff-1a8dc66cf049" status: 200 len: 1738 microversion: 2.20 time: 0.264895 Jul 12 13:36:28.533011 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 368/741] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:36:28 2022] GET /compute/v2.1/servers/90cd5e2a-127d-4329-93ff-1a8dc66cf049 => generated 1738 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:36:28.698020 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-6855c54d-1243-45d9-a373-de6211cd0e67 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:36:28.699471 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-6855c54d-1243-45d9-a373-de6211cd0e67 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] [instance: b05effb3-3e31-4364-bcb3-926c5fab42f2] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:36:28.707165 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-6855c54d-1243-45d9-a373-de6211cd0e67 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:28.707770 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-6855c54d-1243-45d9-a373-de6211cd0e67 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:28.708680 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-6855c54d-1243-45d9-a373-de6211cd0e67 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:28.709224 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-6855c54d-1243-45d9-a373-de6211cd0e67 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:28.726534 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.wsgi [None req-6855c54d-1243-45d9-a373-de6211cd0e67 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] HTTP exception thrown: Instance b05effb3-3e31-4364-bcb3-926c5fab42f2 could not be found. Jul 12 13:36:28.728995 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-6855c54d-1243-45d9-a373-de6211cd0e67 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Request method failure captured: Jul 12 13:36:28.728995 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: request: GET /compute/v2.1/servers/b05effb3-3e31-4364-bcb3-926c5fab42f2 HTTP/1.1 Jul 12 13:36:28.728995 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: Accept: application/json Jul 12 13:36:28.728995 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: Accept-Encoding: identity Jul 12 13:36:28.728995 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: Connection: close Jul 12 13:36:28.728995 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: Content-Length: 0 Jul 12 13:36:28.728995 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: Content-Type: application/json Jul 12 13:36:28.728995 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: Host: 10.222.0.23 Jul 12 13:36:28.728995 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: Openstack-System-Scope: None Jul 12 13:36:28.728995 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: User-Agent: python-urllib3/1.26.9 Jul 12 13:36:28.728995 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Auth-Token: gAAAAABizXjI0qt7cqYMW5NO_6g9VMp_64lCUUs9MeyDHXStIgzeW1Iy7k2clL9uCKK2FaXzt2lIm7Pla2V83mE6NXNwLAE9q62PJJRlL3ufUHmBIxAuXjLWCHoNjF9Yeypuhr3298ySrx2VqSl9UExLr8U_NqQwEYTpeZjDwWeQNYa1orYKqAo Jul 12 13:36:28.728995 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Domain-Id: None Jul 12 13:36:28.728995 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Domain-Name: None Jul 12 13:36:28.728995 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Identity-Status: Confirmed Jul 12 13:36:28.728995 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Is-Admin-Project: True Jul 12 13:36:28.728995 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Project-Domain-Id: default Jul 12 13:36:28.728995 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Project-Domain-Name: Default Jul 12 13:36:28.728995 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Project-Id: a8d960c42bd04476bd6f9b83ae7a2fb6 Jul 12 13:36:28.728995 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Project-Name: tempest-VolumesActionsTest-1559890554 Jul 12 13:36:28.728995 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Role: reader,member Jul 12 13:36:28.728995 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Roles: reader,member Jul 12 13:36:28.731739 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a8d960c42bd04476bd6f9b83ae7a2fb6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a8d960c42bd04476bd6f9b83ae7a2fb6", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a8d960c42bd04476bd6f9b83ae7a2fb6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a8d960c42bd04476bd6f9b83ae7a2fb6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] Jul 12 13:36:28.731739 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Tenant: tempest-VolumesActionsTest-1559890554 Jul 12 13:36:28.731739 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Tenant-Id: a8d960c42bd04476bd6f9b83ae7a2fb6 Jul 12 13:36:28.731739 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Tenant-Name: tempest-VolumesActionsTest-1559890554 Jul 12 13:36:28.731739 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-User: tempest-VolumesActionsTest-1559890554-project Jul 12 13:36:28.731739 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-User-Domain-Id: default Jul 12 13:36:28.731739 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-User-Domain-Name: Default Jul 12 13:36:28.731739 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-User-Id: 9a8c2a9145ac48fd8ddf2f5f76cc6425 Jul 12 13:36:28.731739 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-User-Name: tempest-VolumesActionsTest-1559890554-project Jul 12 13:36:28.731739 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: method: > Jul 12 13:36:28.731739 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: exception: Instance b05effb3-3e31-4364-bcb3-926c5fab42f2 could not be found. Jul 12 13:36:28.731739 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: action_args: {'id': 'b05effb3-3e31-4364-bcb3-926c5fab42f2'} Jul 12 13:36:28.734524 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 13:36:28.734524 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:36:28.734524 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 13:36:28.734524 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 13:36:28.734524 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 13:36:28.734524 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 13:36:28.734524 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 13:36:28.734524 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 13:36:28.734524 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 13:36:28.734524 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 13:36:28.734524 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b05effb3-3e31-4364-bcb3-926c5fab42f2 could not be found. Jul 12 13:36:28.734524 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi Jul 12 13:36:28.734524 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:36:28.734524 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi Jul 12 13:36:28.734524 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:36:28.734524 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:36:28.734524 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:36:28.734524 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 13:36:28.734524 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 13:36:28.734524 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 13:36:28.738032 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:36:28.738032 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 13:36:28.738032 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 13:36:28.738032 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 13:36:28.738032 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 13:36:28.738032 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 13:36:28.738032 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 13:36:28.738032 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b05effb3-3e31-4364-bcb3-926c5fab42f2 could not be found. Jul 12 13:36:28.738032 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi Jul 12 13:36:28.738032 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:36:28.738032 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi Jul 12 13:36:28.738032 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:36:28.738032 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:36:28.738032 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:36:28.738032 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 13:36:28.738032 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 13:36:28.738032 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b05effb3-3e31-4364-bcb3-926c5fab42f2 could not be found. Jul 12 13:36:28.738032 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi Jul 12 13:36:28.742738 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-6855c54d-1243-45d9-a373-de6211cd0e67 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Returning 404 to user: Instance b05effb3-3e31-4364-bcb3-926c5fab42f2 could not be found. {{(pid=117988) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 13:36:28.742738 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-6855c54d-1243-45d9-a373-de6211cd0e67 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] 10.222.0.23 "GET /compute/v2.1/servers/b05effb3-3e31-4364-bcb3-926c5fab42f2" status: 404 len: 111 microversion: 2.1 time: 0.039472 Jul 12 13:36:28.746912 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 374/742] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:36:28 2022] GET /compute/v2.1/servers/b05effb3-3e31-4364-bcb3-926c5fab42f2 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 13:36:28.794297 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-35ae770f-fab3-4c18-8fc7-88ddab9bd4f0 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1807367982", "imageRef": "ce5a4b61-4265-43de-a33e-a23a4c9f612d", "flavorRef": "452", "networks": [{"uuid": "84b6a1fd-f8a1-4143-b73f-88fe536f65a8"}]}} {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:36:28.860100 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.network.neutron [None req-35ae770f-fab3-4c18-8fc7-88ddab9bd4f0 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] validate_networks() for [('84b6a1fd-f8a1-4143-b73f-88fe536f65a8', None, None, None, None, None)] {{(pid=117987) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 13:36:29.099001 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [req-2272e4dd-1c25-4c73-ab49-47924939b860 req-340124fc-e176-45a2-8368-21f68119a967 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a950219a-3350-49e1-ac49-2da471d9b327", "name": "network-vif-deleted", "tag": "f664b5fd-68ee-4047-bbea-3717c70b4099"}]} {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:36:29.118809 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [req-2272e4dd-1c25-4c73-ab49-47924939b860 req-340124fc-e176-45a2-8368-21f68119a967 service nova] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:29.119585 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [req-2272e4dd-1c25-4c73-ab49-47924939b860 req-340124fc-e176-45a2-8368-21f68119a967 service nova] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:29.148202 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.compute.server_external_events [req-2272e4dd-1c25-4c73-ab49-47924939b860 req-340124fc-e176-45a2-8368-21f68119a967 service nova] Creating event network-vif-deleted:f664b5fd-68ee-4047-bbea-3717c70b4099 for instance a950219a-3350-49e1-ac49-2da471d9b327 on hv-cinder-82002 Jul 12 13:36:29.163802 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [req-2272e4dd-1c25-4c73-ab49-47924939b860 req-340124fc-e176-45a2-8368-21f68119a967 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068532 Jul 12 13:36:29.173175 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 375/743] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 12 13:36:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:36:29.487563 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-8640bd8e-ae00-4611-a178-acb5db9f122f tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:36:29.500513 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-8640bd8e-ae00-4611-a178-acb5db9f122f tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] [instance: a950219a-3350-49e1-ac49-2da471d9b327] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:36:29.526728 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-8640bd8e-ae00-4611-a178-acb5db9f122f tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:29.527406 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-8640bd8e-ae00-4611-a178-acb5db9f122f tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:29.536654 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-8640bd8e-ae00-4611-a178-acb5db9f122f tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:29.543003 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-8640bd8e-ae00-4611-a178-acb5db9f122f tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:29.716632 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-8640bd8e-ae00-4611-a178-acb5db9f122f tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa0b8a0b7ff4eb0b13fb985dc0d710a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3897c86b8c847ea9091f3c7ad344fa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:29.728291 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-8640bd8e-ae00-4611-a178-acb5db9f122f tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] 10.222.0.23 "GET /compute/v2.1/servers/a950219a-3350-49e1-ac49-2da471d9b327" status: 200 len: 1225 microversion: 2.1 time: 0.247928 Jul 12 13:36:29.728291 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 376/744] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:36:29 2022] GET /compute/v2.1/servers/a950219a-3350-49e1-ac49-2da471d9b327 => generated 1225 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:36:29.762710 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-f04ae0da-23a3-4f65-a6fc-3168e7ef45c0 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:36:29.763666 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-f04ae0da-23a3-4f65-a6fc-3168e7ef45c0 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 90cd5e2a-127d-4329-93ff-1a8dc66cf049] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:36:29.777723 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-f04ae0da-23a3-4f65-a6fc-3168e7ef45c0 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:29.778673 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-f04ae0da-23a3-4f65-a6fc-3168e7ef45c0 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:29.779666 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-f04ae0da-23a3-4f65-a6fc-3168e7ef45c0 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:29.782160 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-f04ae0da-23a3-4f65-a6fc-3168e7ef45c0 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:29.977502 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.virt.hardware [None req-35ae770f-fab3-4c18-8fc7-88ddab9bd4f0 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Flavor limits 0:0:0 {{(pid=117987) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 13:36:29.978053 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.virt.hardware [None req-35ae770f-fab3-4c18-8fc7-88ddab9bd4f0 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Image limits 0:0:0 {{(pid=117987) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 13:36:29.979026 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.virt.hardware [None req-35ae770f-fab3-4c18-8fc7-88ddab9bd4f0 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Flavor pref 0:0:0 {{(pid=117987) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 13:36:29.979748 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.virt.hardware [None req-35ae770f-fab3-4c18-8fc7-88ddab9bd4f0 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Image pref 0:0:0 {{(pid=117987) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 13:36:29.980451 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.virt.hardware [None req-35ae770f-fab3-4c18-8fc7-88ddab9bd4f0 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117987) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 13:36:30.008903 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-f04ae0da-23a3-4f65-a6fc-3168e7ef45c0 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:30.031923 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-35ae770f-fab3-4c18-8fc7-88ddab9bd4f0 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:30.032764 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-35ae770f-fab3-4c18-8fc7-88ddab9bd4f0 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:30.038658 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-35ae770f-fab3-4c18-8fc7-88ddab9bd4f0 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:30.039980 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-35ae770f-fab3-4c18-8fc7-88ddab9bd4f0 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:30.046644 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-f04ae0da-23a3-4f65-a6fc-3168e7ef45c0 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:30.055455 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-f04ae0da-23a3-4f65-a6fc-3168e7ef45c0 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:30.059538 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-f04ae0da-23a3-4f65-a6fc-3168e7ef45c0 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/90cd5e2a-127d-4329-93ff-1a8dc66cf049" status: 200 len: 1738 microversion: 2.20 time: 0.330017 Jul 12 13:36:30.060389 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 377/745] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:36:29 2022] GET /compute/v2.1/servers/90cd5e2a-127d-4329-93ff-1a8dc66cf049 => generated 1738 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:36:30.071229 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-aae861e9-55a9-40f7-8811-7134d9597cb1 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:36:30.081927 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-aae861e9-55a9-40f7-8811-7134d9597cb1 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] [instance: a4c23b11-fc12-4dd8-8a9c-9019f9e101c9] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:36:30.089470 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-aae861e9-55a9-40f7-8811-7134d9597cb1 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:30.090279 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-aae861e9-55a9-40f7-8811-7134d9597cb1 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:30.091542 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-aae861e9-55a9-40f7-8811-7134d9597cb1 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:30.092377 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-aae861e9-55a9-40f7-8811-7134d9597cb1 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:30.093921 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.quota [None req-35ae770f-fab3-4c18-8fc7-88ddab9bd4f0 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Getting quotas for project a8d960c42bd04476bd6f9b83ae7a2fb6. Resources: {'ram', 'cores', 'instances'} {{(pid=117987) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 13:36:30.105911 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.quota [None req-35ae770f-fab3-4c18-8fc7-88ddab9bd4f0 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Getting quotas for user 9a8c2a9145ac48fd8ddf2f5f76cc6425 and project a8d960c42bd04476bd6f9b83ae7a2fb6. Resources: {'ram', 'cores', 'instances'} {{(pid=117987) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 13:36:30.125602 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-35ae770f-fab3-4c18-8fc7-88ddab9bd4f0 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Going to run 1 instances... {{(pid=117987) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 13:36:30.130083 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-35ae770f-fab3-4c18-8fc7-88ddab9bd4f0 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] [instance: f92d789f-e61f-428b-9898-4debd69b8c71] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ce5a4b61-4265-43de-a33e-a23a4c9f612d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117987) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 13:36:30.133776 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-aae861e9-55a9-40f7-8811-7134d9597cb1 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] 10.222.0.23 "GET /compute/v2.1/servers/a4c23b11-fc12-4dd8-8a9c-9019f9e101c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069731 Jul 12 13:36:30.139944 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 378/746] 10.222.0.23 () {58 vars in 1301 bytes} [Tue Jul 12 13:36:30 2022] GET /compute/v2.1/servers/a4c23b11-fc12-4dd8-8a9c-9019f9e101c9/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:36:30.147057 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-c318a454-e8bb-4fa6-8ba1-1adb5393cece tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:36:30.148952 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-c318a454-e8bb-4fa6-8ba1-1adb5393cece tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] [instance: a4c23b11-fc12-4dd8-8a9c-9019f9e101c9] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:36:30.160577 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-c318a454-e8bb-4fa6-8ba1-1adb5393cece tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:30.161396 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-c318a454-e8bb-4fa6-8ba1-1adb5393cece tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:30.162422 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-c318a454-e8bb-4fa6-8ba1-1adb5393cece tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:30.163179 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-c318a454-e8bb-4fa6-8ba1-1adb5393cece tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:30.210698 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-35ae770f-fab3-4c18-8fc7-88ddab9bd4f0 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.420216 Jul 12 13:36:30.211999 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 369/747] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 12 13:36:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 1422 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 13:36:30.215328 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-c318a454-e8bb-4fa6-8ba1-1adb5393cece tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] 10.222.0.23 "GET /compute/v2.1/servers/a4c23b11-fc12-4dd8-8a9c-9019f9e101c9/os-volume_attachments/6d03df11-b3f3-463a-94cb-abf81670da9a" status: 200 len: 194 microversion: 2.1 time: 0.073979 Jul 12 13:36:30.216124 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 379/748] 10.222.0.23 () {58 vars in 1412 bytes} [Tue Jul 12 13:36:30 2022] GET /compute/v2.1/servers/a4c23b11-fc12-4dd8-8a9c-9019f9e101c9/os-volume_attachments/6d03df11-b3f3-463a-94cb-abf81670da9a => generated 194 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:36:30.234263 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-1d9fa3d6-1f25-43c1-ae4c-e0e49e9c3191 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:36:30.234891 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-1d9fa3d6-1f25-43c1-ae4c-e0e49e9c3191 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] [instance: f92d789f-e61f-428b-9898-4debd69b8c71] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:36:30.311037 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-1d9fa3d6-1f25-43c1-ae4c-e0e49e9c3191 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a8c2a9145ac48fd8ddf2f5f76cc6425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d960c42bd04476bd6f9b83ae7a2fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:30.322058 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-1d9fa3d6-1f25-43c1-ae4c-e0e49e9c3191 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] 10.222.0.23 "GET /compute/v2.1/servers/f92d789f-e61f-428b-9898-4debd69b8c71" status: 200 len: 1214 microversion: 2.1 time: 0.094247 Jul 12 13:36:30.323014 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 370/749] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:36:30 2022] GET /compute/v2.1/servers/f92d789f-e61f-428b-9898-4debd69b8c71 => generated 1214 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:36:30.746256 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-d04f96b5-efee-407d-9bb2-1a28628a0759 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:36:30.747641 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-d04f96b5-efee-407d-9bb2-1a28628a0759 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] [instance: a950219a-3350-49e1-ac49-2da471d9b327] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:36:30.755239 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-d04f96b5-efee-407d-9bb2-1a28628a0759 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:30.756050 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-d04f96b5-efee-407d-9bb2-1a28628a0759 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:30.757254 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-d04f96b5-efee-407d-9bb2-1a28628a0759 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:30.757942 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-d04f96b5-efee-407d-9bb2-1a28628a0759 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:30.776077 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.wsgi [None req-d04f96b5-efee-407d-9bb2-1a28628a0759 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] HTTP exception thrown: Instance a950219a-3350-49e1-ac49-2da471d9b327 could not be found. Jul 12 13:36:30.778041 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-d04f96b5-efee-407d-9bb2-1a28628a0759 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Request method failure captured: Jul 12 13:36:30.778041 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: request: GET /compute/v2.1/servers/a950219a-3350-49e1-ac49-2da471d9b327 HTTP/1.1 Jul 12 13:36:30.778041 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: Accept: application/json Jul 12 13:36:30.778041 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: Accept-Encoding: identity Jul 12 13:36:30.778041 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: Connection: close Jul 12 13:36:30.778041 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: Content-Length: 0 Jul 12 13:36:30.778041 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: Content-Type: application/json Jul 12 13:36:30.778041 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: Host: 10.222.0.23 Jul 12 13:36:30.778041 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: Openstack-System-Scope: None Jul 12 13:36:30.778041 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: User-Agent: python-urllib3/1.26.9 Jul 12 13:36:30.778041 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Auth-Token: gAAAAABizXgTaMQK2Hul7tWxpglI17N05tDe0yoAtYcP0dbhR_NTYgXPaP88DpWTvuSidPfDa-zsfb7SJ4WOHuepIvwjE4zbCUfSMYKkPDXWh7QB1ve1nyn4WrJ8i7MDXR3otIjebGONJYyNaLuMJcwtEFpe5mmYpJmKwnHdJKMpX-MpeCY0JTc Jul 12 13:36:30.778041 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Domain-Id: None Jul 12 13:36:30.778041 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Domain-Name: None Jul 12 13:36:30.778041 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Identity-Status: Confirmed Jul 12 13:36:30.778041 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Is-Admin-Project: True Jul 12 13:36:30.778041 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Project-Domain-Id: default Jul 12 13:36:30.778041 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Project-Domain-Name: Default Jul 12 13:36:30.778041 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Project-Id: b3897c86b8c847ea9091f3c7ad344fa1 Jul 12 13:36:30.778041 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Project-Name: tempest-TestVolumeBootPattern-1901128386 Jul 12 13:36:30.778041 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Role: reader,member Jul 12 13:36:30.778041 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Roles: reader,member Jul 12 13:36:30.779683 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b3897c86b8c847ea9091f3c7ad344fa1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b3897c86b8c847ea9091f3c7ad344fa1", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b3897c86b8c847ea9091f3c7ad344fa1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b3897c86b8c847ea9091f3c7ad344fa1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] Jul 12 13:36:30.779683 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Tenant: tempest-TestVolumeBootPattern-1901128386 Jul 12 13:36:30.779683 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Tenant-Id: b3897c86b8c847ea9091f3c7ad344fa1 Jul 12 13:36:30.779683 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Tenant-Name: tempest-TestVolumeBootPattern-1901128386 Jul 12 13:36:30.779683 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-User: tempest-TestVolumeBootPattern-1901128386-project Jul 12 13:36:30.779683 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-User-Domain-Id: default Jul 12 13:36:30.779683 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-User-Domain-Name: Default Jul 12 13:36:30.779683 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-User-Id: 8aa0b8a0b7ff4eb0b13fb985dc0d710a Jul 12 13:36:30.779683 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-User-Name: tempest-TestVolumeBootPattern-1901128386-project Jul 12 13:36:30.779683 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: method: > Jul 12 13:36:30.779683 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: exception: Instance a950219a-3350-49e1-ac49-2da471d9b327 could not be found. Jul 12 13:36:30.779683 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: action_args: {'id': 'a950219a-3350-49e1-ac49-2da471d9b327'} Jul 12 13:36:30.780757 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 13:36:30.780757 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:36:30.780757 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 13:36:30.780757 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 13:36:30.780757 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 13:36:30.780757 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 13:36:30.780757 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 13:36:30.780757 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 13:36:30.780757 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 13:36:30.780757 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 13:36:30.780757 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a950219a-3350-49e1-ac49-2da471d9b327 could not be found. Jul 12 13:36:30.780757 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi Jul 12 13:36:30.780757 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:36:30.780757 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi Jul 12 13:36:30.780757 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:36:30.780757 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:36:30.780757 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:36:30.780757 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 13:36:30.780757 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 13:36:30.780757 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 13:36:30.782585 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:36:30.782585 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 13:36:30.782585 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 13:36:30.782585 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 13:36:30.782585 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 13:36:30.782585 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 13:36:30.782585 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 13:36:30.782585 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a950219a-3350-49e1-ac49-2da471d9b327 could not be found. Jul 12 13:36:30.782585 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi Jul 12 13:36:30.782585 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:36:30.782585 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi Jul 12 13:36:30.782585 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:36:30.782585 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:36:30.782585 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:36:30.782585 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 13:36:30.782585 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 13:36:30.782585 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a950219a-3350-49e1-ac49-2da471d9b327 could not be found. Jul 12 13:36:30.782585 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi Jul 12 13:36:30.785726 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-d04f96b5-efee-407d-9bb2-1a28628a0759 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Returning 404 to user: Instance a950219a-3350-49e1-ac49-2da471d9b327 could not be found. {{(pid=117988) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 13:36:30.785726 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-d04f96b5-efee-407d-9bb2-1a28628a0759 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] 10.222.0.23 "GET /compute/v2.1/servers/a950219a-3350-49e1-ac49-2da471d9b327" status: 404 len: 111 microversion: 2.1 time: 0.040297 Jul 12 13:36:30.785726 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 380/750] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:36:30 2022] GET /compute/v2.1/servers/a950219a-3350-49e1-ac49-2da471d9b327 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 13:36:30.909278 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-a456ccc3-7ecf-4042-b9d0-ebb23952f7a4 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1779739301", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1091250699", "security_groups": [{"name": "tempest-secgroup-smoke-1984417285"}], "block_device_mapping_v2": [{"uuid": "6a165738-afeb-4c42-9df3-4e78b12430d9", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "3a48b4be-b078-4673-8811-937900491f7b"}]}} {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:36:31.039961 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.network.neutron [None req-a456ccc3-7ecf-4042-b9d0-ebb23952f7a4 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] validate_networks() for [('3a48b4be-b078-4673-8811-937900491f7b', None, None, None, None, None)] {{(pid=117987) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 13:36:31.083413 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-528a3e02-0954-43cd-9549-bc7f3f1c511a tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:36:31.084472 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-528a3e02-0954-43cd-9549-bc7f3f1c511a tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 90cd5e2a-127d-4329-93ff-1a8dc66cf049] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:36:31.094546 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-528a3e02-0954-43cd-9549-bc7f3f1c511a tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:31.095097 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-528a3e02-0954-43cd-9549-bc7f3f1c511a tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:31.096943 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-528a3e02-0954-43cd-9549-bc7f3f1c511a tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:31.097654 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-528a3e02-0954-43cd-9549-bc7f3f1c511a tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:31.308476 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-528a3e02-0954-43cd-9549-bc7f3f1c511a tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:31.312002 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG dbcounter [-] [117988] Writing DB stats nova_cell1:SELECT=100 {{(pid=117988) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:36:31.318184 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-528a3e02-0954-43cd-9549-bc7f3f1c511a tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:31.319716 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-528a3e02-0954-43cd-9549-bc7f3f1c511a tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:31.320902 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-528a3e02-0954-43cd-9549-bc7f3f1c511a tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/90cd5e2a-127d-4329-93ff-1a8dc66cf049" status: 200 len: 1738 microversion: 2.20 time: 0.244547 Jul 12 13:36:31.321676 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 381/751] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:36:31 2022] GET /compute/v2.1/servers/90cd5e2a-127d-4329-93ff-1a8dc66cf049 => generated 1738 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:36:31.340992 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-a0d82093-cc76-485c-bc2e-b24878c09e3c tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:36:31.341655 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-a0d82093-cc76-485c-bc2e-b24878c09e3c tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] [instance: f92d789f-e61f-428b-9898-4debd69b8c71] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:36:31.349476 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-a0d82093-cc76-485c-bc2e-b24878c09e3c tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:31.349853 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-a0d82093-cc76-485c-bc2e-b24878c09e3c tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:31.350636 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-a0d82093-cc76-485c-bc2e-b24878c09e3c tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:31.351582 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-a0d82093-cc76-485c-bc2e-b24878c09e3c tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:31.421158 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-a0d82093-cc76-485c-bc2e-b24878c09e3c tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a8c2a9145ac48fd8ddf2f5f76cc6425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d960c42bd04476bd6f9b83ae7a2fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:31.429690 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-a0d82093-cc76-485c-bc2e-b24878c09e3c tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] 10.222.0.23 "GET /compute/v2.1/servers/f92d789f-e61f-428b-9898-4debd69b8c71" status: 200 len: 1266 microversion: 2.1 time: 0.093878 Jul 12 13:36:31.430281 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 382/752] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:36:31 2022] GET /compute/v2.1/servers/f92d789f-e61f-428b-9898-4debd69b8c71 => generated 1266 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:36:31.551435 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.virt.hardware [None req-a456ccc3-7ecf-4042-b9d0-ebb23952f7a4 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Flavor limits 0:0:0 {{(pid=117987) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 13:36:31.551793 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.virt.hardware [None req-a456ccc3-7ecf-4042-b9d0-ebb23952f7a4 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Image limits 0:0:0 {{(pid=117987) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 13:36:31.552261 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.virt.hardware [None req-a456ccc3-7ecf-4042-b9d0-ebb23952f7a4 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Flavor pref 0:0:0 {{(pid=117987) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 13:36:31.552669 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.virt.hardware [None req-a456ccc3-7ecf-4042-b9d0-ebb23952f7a4 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Image pref 0:0:0 {{(pid=117987) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 13:36:31.553083 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.virt.hardware [None req-a456ccc3-7ecf-4042-b9d0-ebb23952f7a4 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117987) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 13:36:31.564491 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-a456ccc3-7ecf-4042-b9d0-ebb23952f7a4 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:31.565838 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-a456ccc3-7ecf-4042-b9d0-ebb23952f7a4 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:31.567283 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-a456ccc3-7ecf-4042-b9d0-ebb23952f7a4 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:31.568180 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-a456ccc3-7ecf-4042-b9d0-ebb23952f7a4 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:31.594521 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.quota [None req-a456ccc3-7ecf-4042-b9d0-ebb23952f7a4 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Getting quotas for project b3897c86b8c847ea9091f3c7ad344fa1. Resources: {'ram', 'cores', 'instances'} {{(pid=117987) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 13:36:31.599930 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.quota [None req-a456ccc3-7ecf-4042-b9d0-ebb23952f7a4 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Getting quotas for user 8aa0b8a0b7ff4eb0b13fb985dc0d710a and project b3897c86b8c847ea9091f3c7ad344fa1. Resources: {'ram', 'cores', 'instances'} {{(pid=117987) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 13:36:31.670196 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-a456ccc3-7ecf-4042-b9d0-ebb23952f7a4 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Going to run 1 instances... {{(pid=117987) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 13:36:31.672341 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-a456ccc3-7ecf-4042-b9d0-ebb23952f7a4 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] [instance: d44a95a1-4af4-48df-9d5b-5b0d927418f1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6a165738-afeb-4c42-9df3-4e78b12430d9',volume_size=None,volume_type=None)] {{(pid=117987) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 13:36:31.800165 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-9ebb3960-4e08-46f5-8af0-6b654087b7fa tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "11bee16e-0712-42f9-ace7-951331c2175a"}} {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:36:31.801273 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-9ebb3960-4e08-46f5-8af0-6b654087b7fa tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] [instance: a4c23b11-fc12-4dd8-8a9c-9019f9e101c9] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:36:31.809053 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-9ebb3960-4e08-46f5-8af0-6b654087b7fa tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:31.809496 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-9ebb3960-4e08-46f5-8af0-6b654087b7fa tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:31.810280 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-9ebb3960-4e08-46f5-8af0-6b654087b7fa tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:31.810720 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-9ebb3960-4e08-46f5-8af0-6b654087b7fa tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:31.853160 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-a456ccc3-7ecf-4042-b9d0-ebb23952f7a4 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.948180 Jul 12 13:36:31.854417 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 371/753] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jul 12 13:36:30 2022] POST /compute/v2.1/servers => generated 406 bytes in 950 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 13:36:31.865166 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-dcbf76a5-7498-48f8-8a0b-5eb0b1a921cc tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:36:31.866061 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-dcbf76a5-7498-48f8-8a0b-5eb0b1a921cc tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] [instance: d44a95a1-4af4-48df-9d5b-5b0d927418f1] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:36:32.033746 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-dcbf76a5-7498-48f8-8a0b-5eb0b1a921cc tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa0b8a0b7ff4eb0b13fb985dc0d710a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3897c86b8c847ea9091f3c7ad344fa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:32.046608 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-dcbf76a5-7498-48f8-8a0b-5eb0b1a921cc tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] 10.222.0.23 "GET /compute/v2.1/servers/d44a95a1-4af4-48df-9d5b-5b0d927418f1" status: 200 len: 1095 microversion: 2.1 time: 0.186344 Jul 12 13:36:32.047255 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 372/754] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:36:31 2022] GET /compute/v2.1/servers/d44a95a1-4af4-48df-9d5b-5b0d927418f1 => generated 1095 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:36:32.312466 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-9ebb3960-4e08-46f5-8af0-6b654087b7fa tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] 10.222.0.23 "POST /compute/v2.1/servers/a4c23b11-fc12-4dd8-8a9c-9019f9e101c9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.516730 Jul 12 13:36:32.313310 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 383/755] 10.222.0.23 () {60 vars in 1322 bytes} [Tue Jul 12 13:36:31 2022] POST /compute/v2.1/servers/a4c23b11-fc12-4dd8-8a9c-9019f9e101c9/os-volume_attachments => generated 194 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 13:36:32.341760 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-58e90abd-64b1-4eba-bc8c-6671b14f0ca8 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:36:32.343011 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-58e90abd-64b1-4eba-bc8c-6671b14f0ca8 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 90cd5e2a-127d-4329-93ff-1a8dc66cf049] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:36:32.356732 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-58e90abd-64b1-4eba-bc8c-6671b14f0ca8 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:32.357521 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-58e90abd-64b1-4eba-bc8c-6671b14f0ca8 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:32.359483 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-58e90abd-64b1-4eba-bc8c-6671b14f0ca8 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:32.361264 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-58e90abd-64b1-4eba-bc8c-6671b14f0ca8 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:32.455353 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-f8aef56d-3a68-4117-95d8-57f06f2343de tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:36:32.459348 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-f8aef56d-3a68-4117-95d8-57f06f2343de tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] [instance: f92d789f-e61f-428b-9898-4debd69b8c71] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:36:32.473067 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-f8aef56d-3a68-4117-95d8-57f06f2343de tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:32.475441 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-f8aef56d-3a68-4117-95d8-57f06f2343de tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:32.476482 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-f8aef56d-3a68-4117-95d8-57f06f2343de tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:32.476944 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-f8aef56d-3a68-4117-95d8-57f06f2343de tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:32.575066 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-f8aef56d-3a68-4117-95d8-57f06f2343de tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a8c2a9145ac48fd8ddf2f5f76cc6425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d960c42bd04476bd6f9b83ae7a2fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:32.586539 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-f8aef56d-3a68-4117-95d8-57f06f2343de tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] 10.222.0.23 "GET /compute/v2.1/servers/f92d789f-e61f-428b-9898-4debd69b8c71" status: 200 len: 1272 microversion: 2.1 time: 0.142467 Jul 12 13:36:32.588090 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 384/756] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:36:32 2022] GET /compute/v2.1/servers/f92d789f-e61f-428b-9898-4debd69b8c71 => generated 1272 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:36:32.686030 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-58e90abd-64b1-4eba-bc8c-6671b14f0ca8 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:32.697055 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-58e90abd-64b1-4eba-bc8c-6671b14f0ca8 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:32.703197 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-58e90abd-64b1-4eba-bc8c-6671b14f0ca8 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:32.705028 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-58e90abd-64b1-4eba-bc8c-6671b14f0ca8 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/90cd5e2a-127d-4329-93ff-1a8dc66cf049" status: 200 len: 1720 microversion: 2.20 time: 0.368372 Jul 12 13:36:32.717341 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 373/757] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:36:32 2022] GET /compute/v2.1/servers/90cd5e2a-127d-4329-93ff-1a8dc66cf049 => generated 1720 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:36:33.063795 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-b22fbc6e-4787-4fa2-9302-f3dca2cda105 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:36:33.064404 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-b22fbc6e-4787-4fa2-9302-f3dca2cda105 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] [instance: d44a95a1-4af4-48df-9d5b-5b0d927418f1] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:36:33.071552 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-b22fbc6e-4787-4fa2-9302-f3dca2cda105 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:33.072001 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-b22fbc6e-4787-4fa2-9302-f3dca2cda105 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:33.072775 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-b22fbc6e-4787-4fa2-9302-f3dca2cda105 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:33.073210 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-b22fbc6e-4787-4fa2-9302-f3dca2cda105 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:33.138361 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-b22fbc6e-4787-4fa2-9302-f3dca2cda105 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa0b8a0b7ff4eb0b13fb985dc0d710a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3897c86b8c847ea9091f3c7ad344fa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:33.147104 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-b22fbc6e-4787-4fa2-9302-f3dca2cda105 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] 10.222.0.23 "GET /compute/v2.1/servers/d44a95a1-4af4-48df-9d5b-5b0d927418f1" status: 200 len: 1193 microversion: 2.1 time: 0.087330 Jul 12 13:36:33.147680 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 385/758] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:36:33 2022] GET /compute/v2.1/servers/d44a95a1-4af4-48df-9d5b-5b0d927418f1 => generated 1193 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:36:33.604975 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-fd2bd257-9687-46c2-b4be-623a2d2bc2e9 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:36:33.605633 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-fd2bd257-9687-46c2-b4be-623a2d2bc2e9 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] [instance: f92d789f-e61f-428b-9898-4debd69b8c71] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:36:33.612870 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-fd2bd257-9687-46c2-b4be-623a2d2bc2e9 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:33.613303 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-fd2bd257-9687-46c2-b4be-623a2d2bc2e9 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:33.614263 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-fd2bd257-9687-46c2-b4be-623a2d2bc2e9 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:33.614692 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-fd2bd257-9687-46c2-b4be-623a2d2bc2e9 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:33.618988 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG dbcounter [-] [117987] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=117987) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:36:33.725626 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-52e346c9-c513-4fca-8ab7-c00f04f10962 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:36:33.726255 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-52e346c9-c513-4fca-8ab7-c00f04f10962 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 90cd5e2a-127d-4329-93ff-1a8dc66cf049] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:36:33.732893 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-52e346c9-c513-4fca-8ab7-c00f04f10962 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:33.733343 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-52e346c9-c513-4fca-8ab7-c00f04f10962 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:33.734161 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-52e346c9-c513-4fca-8ab7-c00f04f10962 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:33.734598 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-52e346c9-c513-4fca-8ab7-c00f04f10962 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:33.752817 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-fd2bd257-9687-46c2-b4be-623a2d2bc2e9 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a8c2a9145ac48fd8ddf2f5f76cc6425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d960c42bd04476bd6f9b83ae7a2fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:33.760911 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-fd2bd257-9687-46c2-b4be-623a2d2bc2e9 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] 10.222.0.23 "GET /compute/v2.1/servers/f92d789f-e61f-428b-9898-4debd69b8c71" status: 200 len: 1314 microversion: 2.1 time: 0.160058 Jul 12 13:36:33.761701 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 374/759] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:36:33 2022] GET /compute/v2.1/servers/f92d789f-e61f-428b-9898-4debd69b8c71 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:36:33.873191 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [req-138bfeae-c13e-4a0f-9b4e-db54a264fcf3 req-7317c33e-65c2-40fb-b2fe-c76cae13338f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90cd5e2a-127d-4329-93ff-1a8dc66cf049", "name": "network-vif-unplugged", "status": "completed", "tag": "a1218983-36f0-4e25-9df1-d8f2cdfe2972"}]} {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:36:33.881347 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-52e346c9-c513-4fca-8ab7-c00f04f10962 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:33.886248 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [req-138bfeae-c13e-4a0f-9b4e-db54a264fcf3 req-7317c33e-65c2-40fb-b2fe-c76cae13338f service nova] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:33.886698 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [req-138bfeae-c13e-4a0f-9b4e-db54a264fcf3 req-7317c33e-65c2-40fb-b2fe-c76cae13338f service nova] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:33.890161 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-52e346c9-c513-4fca-8ab7-c00f04f10962 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:33.891770 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-52e346c9-c513-4fca-8ab7-c00f04f10962 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:33.893505 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-52e346c9-c513-4fca-8ab7-c00f04f10962 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/90cd5e2a-127d-4329-93ff-1a8dc66cf049" status: 200 len: 1720 microversion: 2.20 time: 0.172064 Jul 12 13:36:33.894494 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 386/760] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:36:33 2022] GET /compute/v2.1/servers/90cd5e2a-127d-4329-93ff-1a8dc66cf049 => generated 1720 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 13:36:33.901128 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.compute.server_external_events [req-138bfeae-c13e-4a0f-9b4e-db54a264fcf3 req-7317c33e-65c2-40fb-b2fe-c76cae13338f service nova] Creating event network-vif-unplugged:a1218983-36f0-4e25-9df1-d8f2cdfe2972 for instance 90cd5e2a-127d-4329-93ff-1a8dc66cf049 on hv-cinder-82002 Jul 12 13:36:33.906233 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [req-138bfeae-c13e-4a0f-9b4e-db54a264fcf3 req-7317c33e-65c2-40fb-b2fe-c76cae13338f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039653 Jul 12 13:36:33.906910 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 375/761] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 12 13:36:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 13:36:34.164439 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-31c61ed8-a67d-45fe-949b-9e2339947069 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:36:34.165059 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-31c61ed8-a67d-45fe-949b-9e2339947069 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] [instance: d44a95a1-4af4-48df-9d5b-5b0d927418f1] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:36:34.171366 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-31c61ed8-a67d-45fe-949b-9e2339947069 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:34.171819 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-31c61ed8-a67d-45fe-949b-9e2339947069 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:34.172597 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-31c61ed8-a67d-45fe-949b-9e2339947069 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:34.173030 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-31c61ed8-a67d-45fe-949b-9e2339947069 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:34.238758 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-31c61ed8-a67d-45fe-949b-9e2339947069 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa0b8a0b7ff4eb0b13fb985dc0d710a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3897c86b8c847ea9091f3c7ad344fa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:34.246476 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-31c61ed8-a67d-45fe-949b-9e2339947069 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] 10.222.0.23 "GET /compute/v2.1/servers/d44a95a1-4af4-48df-9d5b-5b0d927418f1" status: 200 len: 1193 microversion: 2.1 time: 0.085917 Jul 12 13:36:34.247055 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 387/762] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:36:34 2022] GET /compute/v2.1/servers/d44a95a1-4af4-48df-9d5b-5b0d927418f1 => generated 1193 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:36:34.779249 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-a39753e8-5aff-431e-93c1-ddce02974f51 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:36:34.779944 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-a39753e8-5aff-431e-93c1-ddce02974f51 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] [instance: f92d789f-e61f-428b-9898-4debd69b8c71] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:36:34.790998 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-a39753e8-5aff-431e-93c1-ddce02974f51 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:34.792983 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-a39753e8-5aff-431e-93c1-ddce02974f51 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:34.794134 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-a39753e8-5aff-431e-93c1-ddce02974f51 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:34.794846 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-a39753e8-5aff-431e-93c1-ddce02974f51 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:34.911856 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-b0ef78d9-1277-4e76-874a-8333fb14a195 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:36:34.912768 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-b0ef78d9-1277-4e76-874a-8333fb14a195 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 90cd5e2a-127d-4329-93ff-1a8dc66cf049] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:36:34.922390 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-b0ef78d9-1277-4e76-874a-8333fb14a195 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:34.923169 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-b0ef78d9-1277-4e76-874a-8333fb14a195 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:34.925058 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-b0ef78d9-1277-4e76-874a-8333fb14a195 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:34.926329 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-b0ef78d9-1277-4e76-874a-8333fb14a195 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:34.964196 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-a39753e8-5aff-431e-93c1-ddce02974f51 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a8c2a9145ac48fd8ddf2f5f76cc6425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d960c42bd04476bd6f9b83ae7a2fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:34.972317 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-a39753e8-5aff-431e-93c1-ddce02974f51 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] 10.222.0.23 "GET /compute/v2.1/servers/f92d789f-e61f-428b-9898-4debd69b8c71" status: 200 len: 1314 microversion: 2.1 time: 0.197654 Jul 12 13:36:34.982530 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 376/763] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:36:34 2022] GET /compute/v2.1/servers/f92d789f-e61f-428b-9898-4debd69b8c71 => generated 1314 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:36:34.988350 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [req-2b96b662-169f-41cb-aa8e-afbaecd3cb96 req-b48925e3-93be-4f45-9223-e8e0d3302fa4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f92d789f-e61f-428b-9898-4debd69b8c71", "tag": "1e01ea85-e6d2-4fcd-a56a-1653bb077eff"}]} {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:36:34.996829 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [req-2b96b662-169f-41cb-aa8e-afbaecd3cb96 req-b48925e3-93be-4f45-9223-e8e0d3302fa4 service nova] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:34.997273 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [req-2b96b662-169f-41cb-aa8e-afbaecd3cb96 req-b48925e3-93be-4f45-9223-e8e0d3302fa4 service nova] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:35.011515 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.compute.server_external_events [req-2b96b662-169f-41cb-aa8e-afbaecd3cb96 req-b48925e3-93be-4f45-9223-e8e0d3302fa4 service nova] Creating event network-changed:1e01ea85-e6d2-4fcd-a56a-1653bb077eff for instance f92d789f-e61f-428b-9898-4debd69b8c71 on hv-cinder-82002 Jul 12 13:36:35.016941 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [req-2b96b662-169f-41cb-aa8e-afbaecd3cb96 req-b48925e3-93be-4f45-9223-e8e0d3302fa4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032491 Jul 12 13:36:35.017585 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 377/764] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 12 13:36:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:36:35.101191 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-b0ef78d9-1277-4e76-874a-8333fb14a195 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:35.110259 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-b0ef78d9-1277-4e76-874a-8333fb14a195 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:35.112590 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-b0ef78d9-1277-4e76-874a-8333fb14a195 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:35.115055 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-b0ef78d9-1277-4e76-874a-8333fb14a195 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/90cd5e2a-127d-4329-93ff-1a8dc66cf049" status: 200 len: 1723 microversion: 2.20 time: 0.206836 Jul 12 13:36:35.116591 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 388/765] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:36:34 2022] GET /compute/v2.1/servers/90cd5e2a-127d-4329-93ff-1a8dc66cf049 => generated 1723 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 13:36:35.147570 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-448cae43-284d-4a6e-8c06-f9169160ae27 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1ca140eb-f489-4ec5-a0ca-31434b4013c6"}} {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:36:35.149615 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-448cae43-284d-4a6e-8c06-f9169160ae27 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 90cd5e2a-127d-4329-93ff-1a8dc66cf049] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:36:35.162430 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-448cae43-284d-4a6e-8c06-f9169160ae27 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:35.162898 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-448cae43-284d-4a6e-8c06-f9169160ae27 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:35.163887 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-448cae43-284d-4a6e-8c06-f9169160ae27 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:35.165745 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-448cae43-284d-4a6e-8c06-f9169160ae27 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:35.267350 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-53bd983f-69b2-45d1-9e94-fb417c507963 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:36:35.269280 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-53bd983f-69b2-45d1-9e94-fb417c507963 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] [instance: d44a95a1-4af4-48df-9d5b-5b0d927418f1] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:36:35.276396 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-53bd983f-69b2-45d1-9e94-fb417c507963 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:35.276852 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-53bd983f-69b2-45d1-9e94-fb417c507963 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:35.277664 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-53bd983f-69b2-45d1-9e94-fb417c507963 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:35.278280 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-53bd983f-69b2-45d1-9e94-fb417c507963 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:35.366397 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-53bd983f-69b2-45d1-9e94-fb417c507963 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa0b8a0b7ff4eb0b13fb985dc0d710a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3897c86b8c847ea9091f3c7ad344fa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:35.379228 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-53bd983f-69b2-45d1-9e94-fb417c507963 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] 10.222.0.23 "GET /compute/v2.1/servers/d44a95a1-4af4-48df-9d5b-5b0d927418f1" status: 200 len: 1211 microversion: 2.1 time: 0.118225 Jul 12 13:36:35.379988 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 389/766] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:36:35 2022] GET /compute/v2.1/servers/d44a95a1-4af4-48df-9d5b-5b0d927418f1 => generated 1211 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:36:35.568446 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-448cae43-284d-4a6e-8c06-f9169160ae27 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "POST /compute/v2.1/servers/90cd5e2a-127d-4329-93ff-1a8dc66cf049/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.432640 Jul 12 13:36:35.569353 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 378/767] 10.222.0.23 () {62 vars in 1363 bytes} [Tue Jul 12 13:36:35 2022] POST /compute/v2.1/servers/90cd5e2a-127d-4329-93ff-1a8dc66cf049/os-volume_attachments => generated 188 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 13:36:35.736282 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-7f7949e5-7db0-41dd-bca5-c0a6d9f86821 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:36:35.737723 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-7f7949e5-7db0-41dd-bca5-c0a6d9f86821 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 90cd5e2a-127d-4329-93ff-1a8dc66cf049] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:36:35.744009 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-7f7949e5-7db0-41dd-bca5-c0a6d9f86821 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:35.744684 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-7f7949e5-7db0-41dd-bca5-c0a6d9f86821 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:35.745684 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-7f7949e5-7db0-41dd-bca5-c0a6d9f86821 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:35.746127 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-7f7949e5-7db0-41dd-bca5-c0a6d9f86821 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:35.996732 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-184e1a78-c61c-498f-a6fa-8f4ea5e77333 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:36:35.997846 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-184e1a78-c61c-498f-a6fa-8f4ea5e77333 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] [instance: f92d789f-e61f-428b-9898-4debd69b8c71] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:36:36.021517 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-184e1a78-c61c-498f-a6fa-8f4ea5e77333 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:36.022415 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-184e1a78-c61c-498f-a6fa-8f4ea5e77333 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:36.024076 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-184e1a78-c61c-498f-a6fa-8f4ea5e77333 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:36.024990 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-184e1a78-c61c-498f-a6fa-8f4ea5e77333 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:36.084303 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-7f7949e5-7db0-41dd-bca5-c0a6d9f86821 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "DELETE /compute/v2.1/servers/90cd5e2a-127d-4329-93ff-1a8dc66cf049/os-volume_attachments/1ca140eb-f489-4ec5-a0ca-31434b4013c6" status: 202 len: 0 microversion: 2.20 time: 0.351969 Jul 12 13:36:36.084909 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 390/768] 10.222.0.23 () {60 vars in 1456 bytes} [Tue Jul 12 13:36:35 2022] DELETE /compute/v2.1/servers/90cd5e2a-127d-4329-93ff-1a8dc66cf049/os-volume_attachments/1ca140eb-f489-4ec5-a0ca-31434b4013c6 => generated 0 bytes in 353 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 12 13:36:36.150138 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-3cfbb434-08bc-4f3c-acb2-41263fd29ede tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:36:36.151449 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-3cfbb434-08bc-4f3c-acb2-41263fd29ede tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 90cd5e2a-127d-4329-93ff-1a8dc66cf049] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:36:36.158089 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-3cfbb434-08bc-4f3c-acb2-41263fd29ede tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:36.158801 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-3cfbb434-08bc-4f3c-acb2-41263fd29ede tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:36.159581 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-3cfbb434-08bc-4f3c-acb2-41263fd29ede tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:36.160019 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-3cfbb434-08bc-4f3c-acb2-41263fd29ede tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:36.275569 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-3cfbb434-08bc-4f3c-acb2-41263fd29ede tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "POST /compute/v2.1/servers/90cd5e2a-127d-4329-93ff-1a8dc66cf049/action" status: 202 len: 0 microversion: 2.20 time: 0.130942 Jul 12 13:36:36.276569 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 391/769] 10.222.0.23 () {62 vars in 1318 bytes} [Tue Jul 12 13:36:36 2022] POST /compute/v2.1/servers/90cd5e2a-127d-4329-93ff-1a8dc66cf049/action => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 12 13:36:36.285005 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-7be046e7-ac2d-43a2-9285-6cc04b7f336a tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:36:36.285760 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-7be046e7-ac2d-43a2-9285-6cc04b7f336a tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 90cd5e2a-127d-4329-93ff-1a8dc66cf049] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:36:36.292570 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-7be046e7-ac2d-43a2-9285-6cc04b7f336a tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:36.293097 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-7be046e7-ac2d-43a2-9285-6cc04b7f336a tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:36.294052 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-7be046e7-ac2d-43a2-9285-6cc04b7f336a tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:36.295233 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-7be046e7-ac2d-43a2-9285-6cc04b7f336a tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:36.302729 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-184e1a78-c61c-498f-a6fa-8f4ea5e77333 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a8c2a9145ac48fd8ddf2f5f76cc6425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d960c42bd04476bd6f9b83ae7a2fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:36.310651 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-184e1a78-c61c-498f-a6fa-8f4ea5e77333 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] 10.222.0.23 "GET /compute/v2.1/servers/f92d789f-e61f-428b-9898-4debd69b8c71" status: 200 len: 1314 microversion: 2.1 time: 0.325010 Jul 12 13:36:36.311252 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 379/770] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:36:35 2022] GET /compute/v2.1/servers/f92d789f-e61f-428b-9898-4debd69b8c71 => generated 1314 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:36:36.396697 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-ebfee33e-6ec4-4eae-8a0e-8c7f399ae31e tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:36:36.397313 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-ebfee33e-6ec4-4eae-8a0e-8c7f399ae31e tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] [instance: d44a95a1-4af4-48df-9d5b-5b0d927418f1] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:36:36.403875 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-ebfee33e-6ec4-4eae-8a0e-8c7f399ae31e tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:36.404663 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-ebfee33e-6ec4-4eae-8a0e-8c7f399ae31e tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:36.405549 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-ebfee33e-6ec4-4eae-8a0e-8c7f399ae31e tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:36.406232 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-ebfee33e-6ec4-4eae-8a0e-8c7f399ae31e tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:36.604387 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-7be046e7-ac2d-43a2-9285-6cc04b7f336a tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:36.613600 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-7be046e7-ac2d-43a2-9285-6cc04b7f336a tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:36.615307 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-7be046e7-ac2d-43a2-9285-6cc04b7f336a tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:36.636118 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-7be046e7-ac2d-43a2-9285-6cc04b7f336a tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/90cd5e2a-127d-4329-93ff-1a8dc66cf049" status: 200 len: 1671 microversion: 2.20 time: 0.355522 Jul 12 13:36:36.647746 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 392/771] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:36:36 2022] GET /compute/v2.1/servers/90cd5e2a-127d-4329-93ff-1a8dc66cf049 => generated 1671 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 13:36:36.661604 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-ebfee33e-6ec4-4eae-8a0e-8c7f399ae31e tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa0b8a0b7ff4eb0b13fb985dc0d710a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3897c86b8c847ea9091f3c7ad344fa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:36.676652 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-ebfee33e-6ec4-4eae-8a0e-8c7f399ae31e tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] 10.222.0.23 "GET /compute/v2.1/servers/d44a95a1-4af4-48df-9d5b-5b0d927418f1" status: 200 len: 1279 microversion: 2.1 time: 0.284309 Jul 12 13:36:36.678388 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 380/772] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:36:36 2022] GET /compute/v2.1/servers/d44a95a1-4af4-48df-9d5b-5b0d927418f1 => generated 1279 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:36:37.006977 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [req-f61aca1e-bc0e-4cc4-b6dd-98b54cf9d938 req-c145ceb0-f7b8-4922-8bef-5d6ebc4dd65c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d44a95a1-4af4-48df-9d5b-5b0d927418f1", "tag": "cda66e5a-baa7-4459-95c8-2a183c1b2f13"}]} {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:36:37.017084 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [req-f61aca1e-bc0e-4cc4-b6dd-98b54cf9d938 req-c145ceb0-f7b8-4922-8bef-5d6ebc4dd65c service nova] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:37.017565 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [req-f61aca1e-bc0e-4cc4-b6dd-98b54cf9d938 req-c145ceb0-f7b8-4922-8bef-5d6ebc4dd65c service nova] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:37.040166 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.compute.server_external_events [req-f61aca1e-bc0e-4cc4-b6dd-98b54cf9d938 req-c145ceb0-f7b8-4922-8bef-5d6ebc4dd65c service nova] Creating event network-changed:cda66e5a-baa7-4459-95c8-2a183c1b2f13 for instance d44a95a1-4af4-48df-9d5b-5b0d927418f1 on hv-cinder-82002 Jul 12 13:36:37.045553 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [req-f61aca1e-bc0e-4cc4-b6dd-98b54cf9d938 req-c145ceb0-f7b8-4922-8bef-5d6ebc4dd65c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046093 Jul 12 13:36:37.046498 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 393/773] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 12 13:36:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 13:36:37.328267 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-f3ee4111-e956-471d-bbe0-ef0eecbce886 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:36:37.328894 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-f3ee4111-e956-471d-bbe0-ef0eecbce886 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] [instance: f92d789f-e61f-428b-9898-4debd69b8c71] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:36:37.335674 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-f3ee4111-e956-471d-bbe0-ef0eecbce886 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:37.336116 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-f3ee4111-e956-471d-bbe0-ef0eecbce886 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:37.336876 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-f3ee4111-e956-471d-bbe0-ef0eecbce886 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:37.337409 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-f3ee4111-e956-471d-bbe0-ef0eecbce886 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:37.473000 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-f3ee4111-e956-471d-bbe0-ef0eecbce886 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a8c2a9145ac48fd8ddf2f5f76cc6425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d960c42bd04476bd6f9b83ae7a2fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:37.480826 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-f3ee4111-e956-471d-bbe0-ef0eecbce886 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] 10.222.0.23 "GET /compute/v2.1/servers/f92d789f-e61f-428b-9898-4debd69b8c71" status: 200 len: 1314 microversion: 2.1 time: 0.156564 Jul 12 13:36:37.481432 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 381/774] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:36:37 2022] GET /compute/v2.1/servers/f92d789f-e61f-428b-9898-4debd69b8c71 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:36:37.656123 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-3feeb2d3-5bf5-4813-8476-09da856ad85f tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:36:37.656732 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-3feeb2d3-5bf5-4813-8476-09da856ad85f tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 90cd5e2a-127d-4329-93ff-1a8dc66cf049] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:36:37.664368 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-3feeb2d3-5bf5-4813-8476-09da856ad85f tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:37.664815 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-3feeb2d3-5bf5-4813-8476-09da856ad85f tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:37.665631 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-3feeb2d3-5bf5-4813-8476-09da856ad85f tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:37.666075 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-3feeb2d3-5bf5-4813-8476-09da856ad85f tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:37.682460 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG dbcounter [-] [117988] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=7,nova_cell1:INSERT=4 {{(pid=117988) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:36:37.695112 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-1d2738af-d3c1-4ac6-be6f-49d96cd67902 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:36:37.695735 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-1d2738af-d3c1-4ac6-be6f-49d96cd67902 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] [instance: d44a95a1-4af4-48df-9d5b-5b0d927418f1] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:36:37.702101 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-1d2738af-d3c1-4ac6-be6f-49d96cd67902 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:37.702554 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-1d2738af-d3c1-4ac6-be6f-49d96cd67902 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:37.703334 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-1d2738af-d3c1-4ac6-be6f-49d96cd67902 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:37.703767 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-1d2738af-d3c1-4ac6-be6f-49d96cd67902 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:37.868601 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-3feeb2d3-5bf5-4813-8476-09da856ad85f tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:37.878472 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-3feeb2d3-5bf5-4813-8476-09da856ad85f tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:37.880447 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-3feeb2d3-5bf5-4813-8476-09da856ad85f tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:37.881689 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-3feeb2d3-5bf5-4813-8476-09da856ad85f tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/90cd5e2a-127d-4329-93ff-1a8dc66cf049" status: 200 len: 1671 microversion: 2.20 time: 0.230001 Jul 12 13:36:37.882262 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 394/775] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:36:37 2022] GET /compute/v2.1/servers/90cd5e2a-127d-4329-93ff-1a8dc66cf049 => generated 1671 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:36:37.903882 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-1d2738af-d3c1-4ac6-be6f-49d96cd67902 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa0b8a0b7ff4eb0b13fb985dc0d710a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3897c86b8c847ea9091f3c7ad344fa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:37.912023 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-1d2738af-d3c1-4ac6-be6f-49d96cd67902 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] 10.222.0.23 "GET /compute/v2.1/servers/d44a95a1-4af4-48df-9d5b-5b0d927418f1" status: 200 len: 1279 microversion: 2.1 time: 0.220832 Jul 12 13:36:37.922428 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 382/776] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:36:37 2022] GET /compute/v2.1/servers/d44a95a1-4af4-48df-9d5b-5b0d927418f1 => generated 1279 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:36:38.498628 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-5f64730a-4f9c-452f-a2a6-e2c97a59d393 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:36:38.499296 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-5f64730a-4f9c-452f-a2a6-e2c97a59d393 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] [instance: f92d789f-e61f-428b-9898-4debd69b8c71] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:36:38.507038 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-5f64730a-4f9c-452f-a2a6-e2c97a59d393 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:38.507486 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-5f64730a-4f9c-452f-a2a6-e2c97a59d393 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:38.508262 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-5f64730a-4f9c-452f-a2a6-e2c97a59d393 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:38.508698 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-5f64730a-4f9c-452f-a2a6-e2c97a59d393 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:38.740315 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-5f64730a-4f9c-452f-a2a6-e2c97a59d393 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a8c2a9145ac48fd8ddf2f5f76cc6425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d960c42bd04476bd6f9b83ae7a2fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:38.748910 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-5f64730a-4f9c-452f-a2a6-e2c97a59d393 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] 10.222.0.23 "GET /compute/v2.1/servers/f92d789f-e61f-428b-9898-4debd69b8c71" status: 200 len: 1314 microversion: 2.1 time: 0.254027 Jul 12 13:36:38.749920 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 395/777] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:36:38 2022] GET /compute/v2.1/servers/f92d789f-e61f-428b-9898-4debd69b8c71 => generated 1314 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:36:38.900483 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-638528cb-29c2-49e2-beb0-3b02b948ff4d tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:36:38.901417 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-638528cb-29c2-49e2-beb0-3b02b948ff4d tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 90cd5e2a-127d-4329-93ff-1a8dc66cf049] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:36:38.909314 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-638528cb-29c2-49e2-beb0-3b02b948ff4d tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:38.909960 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-638528cb-29c2-49e2-beb0-3b02b948ff4d tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:38.910990 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-638528cb-29c2-49e2-beb0-3b02b948ff4d tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:38.911525 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-638528cb-29c2-49e2-beb0-3b02b948ff4d tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:38.931264 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-a67af01f-fc6f-43c9-a392-ac1af6f34fc5 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:36:38.932903 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-a67af01f-fc6f-43c9-a392-ac1af6f34fc5 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] [instance: d44a95a1-4af4-48df-9d5b-5b0d927418f1] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:36:38.941445 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-a67af01f-fc6f-43c9-a392-ac1af6f34fc5 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:38.942798 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-a67af01f-fc6f-43c9-a392-ac1af6f34fc5 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:38.944320 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-a67af01f-fc6f-43c9-a392-ac1af6f34fc5 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:38.945267 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-a67af01f-fc6f-43c9-a392-ac1af6f34fc5 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:39.385453 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-638528cb-29c2-49e2-beb0-3b02b948ff4d tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:39.395618 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-638528cb-29c2-49e2-beb0-3b02b948ff4d tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:39.397122 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-638528cb-29c2-49e2-beb0-3b02b948ff4d tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:39.398324 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-638528cb-29c2-49e2-beb0-3b02b948ff4d tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/90cd5e2a-127d-4329-93ff-1a8dc66cf049" status: 200 len: 1729 microversion: 2.20 time: 0.501892 Jul 12 13:36:39.399090 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 383/778] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:36:38 2022] GET /compute/v2.1/servers/90cd5e2a-127d-4329-93ff-1a8dc66cf049 => generated 1729 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:36:39.399840 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-a67af01f-fc6f-43c9-a392-ac1af6f34fc5 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa0b8a0b7ff4eb0b13fb985dc0d710a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3897c86b8c847ea9091f3c7ad344fa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:39.407796 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-a67af01f-fc6f-43c9-a392-ac1af6f34fc5 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] 10.222.0.23 "GET /compute/v2.1/servers/d44a95a1-4af4-48df-9d5b-5b0d927418f1" status: 200 len: 1279 microversion: 2.1 time: 0.481472 Jul 12 13:36:39.408934 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 396/779] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:36:38 2022] GET /compute/v2.1/servers/d44a95a1-4af4-48df-9d5b-5b0d927418f1 => generated 1279 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:36:39.766241 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-1f558760-f8dc-4388-924c-75e0d8fb06cd tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:36:39.767005 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-1f558760-f8dc-4388-924c-75e0d8fb06cd tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] [instance: f92d789f-e61f-428b-9898-4debd69b8c71] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:36:39.774321 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-1f558760-f8dc-4388-924c-75e0d8fb06cd tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:39.774901 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-1f558760-f8dc-4388-924c-75e0d8fb06cd tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:39.775772 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-1f558760-f8dc-4388-924c-75e0d8fb06cd tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:39.776298 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-1f558760-f8dc-4388-924c-75e0d8fb06cd tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:40.041261 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-1f558760-f8dc-4388-924c-75e0d8fb06cd tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a8c2a9145ac48fd8ddf2f5f76cc6425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d960c42bd04476bd6f9b83ae7a2fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:40.053756 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-1f558760-f8dc-4388-924c-75e0d8fb06cd tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] 10.222.0.23 "GET /compute/v2.1/servers/f92d789f-e61f-428b-9898-4debd69b8c71" status: 200 len: 1314 microversion: 2.1 time: 0.291144 Jul 12 13:36:40.054971 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 384/780] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:36:39 2022] GET /compute/v2.1/servers/f92d789f-e61f-428b-9898-4debd69b8c71 => generated 1314 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:36:40.419851 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-b344a8df-274b-4df6-b353-ea14e09d1cc8 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:36:40.421317 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-b344a8df-274b-4df6-b353-ea14e09d1cc8 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 90cd5e2a-127d-4329-93ff-1a8dc66cf049] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:36:40.425941 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-a1f3cbb4-5354-4e20-a40a-e2c7cea17bc6 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:36:40.426865 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-a1f3cbb4-5354-4e20-a40a-e2c7cea17bc6 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] [instance: d44a95a1-4af4-48df-9d5b-5b0d927418f1] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:36:40.430003 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-b344a8df-274b-4df6-b353-ea14e09d1cc8 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:40.430744 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-b344a8df-274b-4df6-b353-ea14e09d1cc8 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:40.431794 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-b344a8df-274b-4df6-b353-ea14e09d1cc8 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:40.432468 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-b344a8df-274b-4df6-b353-ea14e09d1cc8 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:40.434655 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-a1f3cbb4-5354-4e20-a40a-e2c7cea17bc6 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:40.435104 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-a1f3cbb4-5354-4e20-a40a-e2c7cea17bc6 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:40.437725 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-a1f3cbb4-5354-4e20-a40a-e2c7cea17bc6 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:40.438445 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-a1f3cbb4-5354-4e20-a40a-e2c7cea17bc6 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:40.704465 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-b344a8df-274b-4df6-b353-ea14e09d1cc8 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:40.713942 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-b344a8df-274b-4df6-b353-ea14e09d1cc8 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:40.715573 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-b344a8df-274b-4df6-b353-ea14e09d1cc8 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:40.716826 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-b344a8df-274b-4df6-b353-ea14e09d1cc8 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/90cd5e2a-127d-4329-93ff-1a8dc66cf049" status: 200 len: 1729 microversion: 2.20 time: 0.302737 Jul 12 13:36:40.717719 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 397/781] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:36:40 2022] GET /compute/v2.1/servers/90cd5e2a-127d-4329-93ff-1a8dc66cf049 => generated 1729 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:36:40.740075 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-a1f3cbb4-5354-4e20-a40a-e2c7cea17bc6 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa0b8a0b7ff4eb0b13fb985dc0d710a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3897c86b8c847ea9091f3c7ad344fa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:40.748434 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-a1f3cbb4-5354-4e20-a40a-e2c7cea17bc6 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] 10.222.0.23 "GET /compute/v2.1/servers/d44a95a1-4af4-48df-9d5b-5b0d927418f1" status: 200 len: 1279 microversion: 2.1 time: 0.326386 Jul 12 13:36:40.749139 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 385/782] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:36:40 2022] GET /compute/v2.1/servers/d44a95a1-4af4-48df-9d5b-5b0d927418f1 => generated 1279 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:36:41.073005 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-ab309fe2-6c02-41ae-a108-ee40f2af47d9 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:36:41.074009 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-ab309fe2-6c02-41ae-a108-ee40f2af47d9 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] [instance: f92d789f-e61f-428b-9898-4debd69b8c71] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:36:41.081676 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-ab309fe2-6c02-41ae-a108-ee40f2af47d9 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:41.082410 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-ab309fe2-6c02-41ae-a108-ee40f2af47d9 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:41.083392 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-ab309fe2-6c02-41ae-a108-ee40f2af47d9 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:41.083995 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-ab309fe2-6c02-41ae-a108-ee40f2af47d9 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:41.232494 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-ab309fe2-6c02-41ae-a108-ee40f2af47d9 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a8c2a9145ac48fd8ddf2f5f76cc6425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d960c42bd04476bd6f9b83ae7a2fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:41.240733 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-ab309fe2-6c02-41ae-a108-ee40f2af47d9 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] 10.222.0.23 "GET /compute/v2.1/servers/f92d789f-e61f-428b-9898-4debd69b8c71" status: 200 len: 1314 microversion: 2.1 time: 0.172206 Jul 12 13:36:41.241321 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 398/783] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:36:41 2022] GET /compute/v2.1/servers/f92d789f-e61f-428b-9898-4debd69b8c71 => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:36:41.736297 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-889d3894-4344-4414-9d34-c3cedc034de9 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:36:41.736964 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-889d3894-4344-4414-9d34-c3cedc034de9 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 90cd5e2a-127d-4329-93ff-1a8dc66cf049] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:36:41.739697 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG dbcounter [-] [117987] Writing DB stats nova_cell0:SELECT=4 {{(pid=117987) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:36:41.747205 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-889d3894-4344-4414-9d34-c3cedc034de9 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:41.747648 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-889d3894-4344-4414-9d34-c3cedc034de9 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:41.748422 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-889d3894-4344-4414-9d34-c3cedc034de9 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:41.748852 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-889d3894-4344-4414-9d34-c3cedc034de9 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:41.766773 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-2b0ba2e1-6cf0-4b2b-83ea-5c266a34b9e6 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:36:41.769318 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-2b0ba2e1-6cf0-4b2b-83ea-5c266a34b9e6 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] [instance: d44a95a1-4af4-48df-9d5b-5b0d927418f1] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:36:41.782184 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-2b0ba2e1-6cf0-4b2b-83ea-5c266a34b9e6 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:41.782760 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-2b0ba2e1-6cf0-4b2b-83ea-5c266a34b9e6 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:41.784241 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-2b0ba2e1-6cf0-4b2b-83ea-5c266a34b9e6 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:41.785001 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-2b0ba2e1-6cf0-4b2b-83ea-5c266a34b9e6 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:42.039836 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG dbcounter [-] [117987] Writing DB stats nova_cell0:SELECT=16 {{(pid=117987) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:36:42.081296 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-889d3894-4344-4414-9d34-c3cedc034de9 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:42.087190 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-2b0ba2e1-6cf0-4b2b-83ea-5c266a34b9e6 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa0b8a0b7ff4eb0b13fb985dc0d710a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3897c86b8c847ea9091f3c7ad344fa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:42.093687 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-889d3894-4344-4414-9d34-c3cedc034de9 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:42.098642 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-889d3894-4344-4414-9d34-c3cedc034de9 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:42.100189 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-889d3894-4344-4414-9d34-c3cedc034de9 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/90cd5e2a-127d-4329-93ff-1a8dc66cf049" status: 200 len: 1729 microversion: 2.20 time: 0.367818 Jul 12 13:36:42.101259 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 386/784] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:36:41 2022] GET /compute/v2.1/servers/90cd5e2a-127d-4329-93ff-1a8dc66cf049 => generated 1729 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:36:42.106614 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [req-b065e671-a977-4c0c-94b8-3c88ddd83c6e req-f6d63d04-8f6c-439e-a0d4-0154f70decad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f92d789f-e61f-428b-9898-4debd69b8c71", "name": "network-vif-plugged", "status": "completed", "tag": "1e01ea85-e6d2-4fcd-a56a-1653bb077eff"}]} {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:36:42.111992 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-2b0ba2e1-6cf0-4b2b-83ea-5c266a34b9e6 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] 10.222.0.23 "GET /compute/v2.1/servers/d44a95a1-4af4-48df-9d5b-5b0d927418f1" status: 200 len: 1279 microversion: 2.1 time: 0.349771 Jul 12 13:36:42.122074 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 399/785] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:36:41 2022] GET /compute/v2.1/servers/d44a95a1-4af4-48df-9d5b-5b0d927418f1 => generated 1279 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:36:42.133199 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [req-b065e671-a977-4c0c-94b8-3c88ddd83c6e req-f6d63d04-8f6c-439e-a0d4-0154f70decad service nova] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:42.137657 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [req-b065e671-a977-4c0c-94b8-3c88ddd83c6e req-f6d63d04-8f6c-439e-a0d4-0154f70decad service nova] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:42.159762 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.compute.server_external_events [req-b065e671-a977-4c0c-94b8-3c88ddd83c6e req-f6d63d04-8f6c-439e-a0d4-0154f70decad service nova] Creating event network-vif-plugged:1e01ea85-e6d2-4fcd-a56a-1653bb077eff for instance f92d789f-e61f-428b-9898-4debd69b8c71 on hv-cinder-82002 Jul 12 13:36:42.166342 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [req-b065e671-a977-4c0c-94b8-3c88ddd83c6e req-f6d63d04-8f6c-439e-a0d4-0154f70decad service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063638 Jul 12 13:36:42.167051 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 387/786] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 12 13:36:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:36:42.259301 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-73303f6a-ab95-48dc-959a-5b21cc76a72e tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:36:42.260128 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-73303f6a-ab95-48dc-959a-5b21cc76a72e tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] [instance: f92d789f-e61f-428b-9898-4debd69b8c71] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:36:42.269048 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-73303f6a-ab95-48dc-959a-5b21cc76a72e tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:42.269911 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-73303f6a-ab95-48dc-959a-5b21cc76a72e tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:42.271295 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-73303f6a-ab95-48dc-959a-5b21cc76a72e tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:42.272139 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-73303f6a-ab95-48dc-959a-5b21cc76a72e tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:42.444788 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-73303f6a-ab95-48dc-959a-5b21cc76a72e tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a8c2a9145ac48fd8ddf2f5f76cc6425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d960c42bd04476bd6f9b83ae7a2fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:42.452994 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-73303f6a-ab95-48dc-959a-5b21cc76a72e tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] 10.222.0.23 "GET /compute/v2.1/servers/f92d789f-e61f-428b-9898-4debd69b8c71" status: 200 len: 1314 microversion: 2.1 time: 0.198262 Jul 12 13:36:42.453714 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 400/787] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:36:42 2022] GET /compute/v2.1/servers/f92d789f-e61f-428b-9898-4debd69b8c71 => generated 1314 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:36:43.120473 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-c053f7c2-d6fd-4672-8c4a-0dc9cb9a4f1d tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:36:43.121157 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-c053f7c2-d6fd-4672-8c4a-0dc9cb9a4f1d tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 90cd5e2a-127d-4329-93ff-1a8dc66cf049] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:36:43.123587 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG dbcounter [-] [117987] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:INSERT=6 {{(pid=117987) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:36:43.130209 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-75cdca77-b679-4266-962a-78624883acc9 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:36:43.130797 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-c053f7c2-d6fd-4672-8c4a-0dc9cb9a4f1d tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:43.130797 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-c053f7c2-d6fd-4672-8c4a-0dc9cb9a4f1d tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:43.131013 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-75cdca77-b679-4266-962a-78624883acc9 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] [instance: d44a95a1-4af4-48df-9d5b-5b0d927418f1] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:36:43.131406 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-c053f7c2-d6fd-4672-8c4a-0dc9cb9a4f1d tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:43.131832 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-c053f7c2-d6fd-4672-8c4a-0dc9cb9a4f1d tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:43.139250 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-75cdca77-b679-4266-962a-78624883acc9 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:43.139708 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-75cdca77-b679-4266-962a-78624883acc9 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:43.140485 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-75cdca77-b679-4266-962a-78624883acc9 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:43.140916 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-75cdca77-b679-4266-962a-78624883acc9 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:43.391119 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-c053f7c2-d6fd-4672-8c4a-0dc9cb9a4f1d tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:43.397628 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-75cdca77-b679-4266-962a-78624883acc9 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa0b8a0b7ff4eb0b13fb985dc0d710a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3897c86b8c847ea9091f3c7ad344fa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:43.406424 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-75cdca77-b679-4266-962a-78624883acc9 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] 10.222.0.23 "GET /compute/v2.1/servers/d44a95a1-4af4-48df-9d5b-5b0d927418f1" status: 200 len: 1279 microversion: 2.1 time: 0.281475 Jul 12 13:36:43.407154 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-c053f7c2-d6fd-4672-8c4a-0dc9cb9a4f1d tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:43.413443 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-c053f7c2-d6fd-4672-8c4a-0dc9cb9a4f1d tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:43.413738 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 401/788] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:36:43 2022] GET /compute/v2.1/servers/d44a95a1-4af4-48df-9d5b-5b0d927418f1 => generated 1279 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:36:43.413895 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-c053f7c2-d6fd-4672-8c4a-0dc9cb9a4f1d tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/90cd5e2a-127d-4329-93ff-1a8dc66cf049" status: 200 len: 1729 microversion: 2.20 time: 0.295108 Jul 12 13:36:43.413895 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 388/789] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:36:43 2022] GET /compute/v2.1/servers/90cd5e2a-127d-4329-93ff-1a8dc66cf049 => generated 1729 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:36:43.472261 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-f64ec376-afac-4f79-a326-39af629c8697 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:36:43.472895 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-f64ec376-afac-4f79-a326-39af629c8697 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] [instance: f92d789f-e61f-428b-9898-4debd69b8c71] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:36:43.479877 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-f64ec376-afac-4f79-a326-39af629c8697 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:43.480340 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-f64ec376-afac-4f79-a326-39af629c8697 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:43.481120 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-f64ec376-afac-4f79-a326-39af629c8697 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:43.481841 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-f64ec376-afac-4f79-a326-39af629c8697 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:43.673634 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-f64ec376-afac-4f79-a326-39af629c8697 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a8c2a9145ac48fd8ddf2f5f76cc6425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d960c42bd04476bd6f9b83ae7a2fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:43.682201 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-f64ec376-afac-4f79-a326-39af629c8697 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] 10.222.0.23 "GET /compute/v2.1/servers/f92d789f-e61f-428b-9898-4debd69b8c71" status: 200 len: 1314 microversion: 2.1 time: 0.214552 Jul 12 13:36:43.682895 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 402/790] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:36:43 2022] GET /compute/v2.1/servers/f92d789f-e61f-428b-9898-4debd69b8c71 => generated 1314 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:36:44.425125 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-f3172f3f-9f26-481c-89e2-16039bb199f9 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:36:44.425772 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-f3172f3f-9f26-481c-89e2-16039bb199f9 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] [instance: d44a95a1-4af4-48df-9d5b-5b0d927418f1] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:36:44.429910 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-279ba9be-de76-4074-a575-8d22e977ce1d tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:36:44.430525 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-279ba9be-de76-4074-a575-8d22e977ce1d tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 90cd5e2a-127d-4329-93ff-1a8dc66cf049] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:36:44.432611 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-f3172f3f-9f26-481c-89e2-16039bb199f9 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:44.433059 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-f3172f3f-9f26-481c-89e2-16039bb199f9 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:44.433872 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-f3172f3f-9f26-481c-89e2-16039bb199f9 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:44.434287 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-f3172f3f-9f26-481c-89e2-16039bb199f9 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:44.437141 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-279ba9be-de76-4074-a575-8d22e977ce1d tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:44.437625 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-279ba9be-de76-4074-a575-8d22e977ce1d tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:44.438393 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-279ba9be-de76-4074-a575-8d22e977ce1d tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:44.438856 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-279ba9be-de76-4074-a575-8d22e977ce1d tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:44.678472 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-279ba9be-de76-4074-a575-8d22e977ce1d tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:44.682192 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-f3172f3f-9f26-481c-89e2-16039bb199f9 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa0b8a0b7ff4eb0b13fb985dc0d710a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3897c86b8c847ea9091f3c7ad344fa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:44.689845 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-279ba9be-de76-4074-a575-8d22e977ce1d tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:44.690197 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-f3172f3f-9f26-481c-89e2-16039bb199f9 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] 10.222.0.23 "GET /compute/v2.1/servers/d44a95a1-4af4-48df-9d5b-5b0d927418f1" status: 200 len: 1279 microversion: 2.1 time: 0.269365 Jul 12 13:36:44.690815 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 389/791] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:36:44 2022] GET /compute/v2.1/servers/d44a95a1-4af4-48df-9d5b-5b0d927418f1 => generated 1279 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:36:44.691796 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-279ba9be-de76-4074-a575-8d22e977ce1d tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:44.693262 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-279ba9be-de76-4074-a575-8d22e977ce1d tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/90cd5e2a-127d-4329-93ff-1a8dc66cf049" status: 200 len: 1729 microversion: 2.20 time: 0.267472 Jul 12 13:36:44.701244 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-12170a97-f37e-4154-88e4-12f5b4bc5ce1 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:36:44.701971 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 403/792] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:36:44 2022] GET /compute/v2.1/servers/90cd5e2a-127d-4329-93ff-1a8dc66cf049 => generated 1729 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 13:36:44.702111 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-12170a97-f37e-4154-88e4-12f5b4bc5ce1 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] [instance: f92d789f-e61f-428b-9898-4debd69b8c71] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:36:44.709168 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-12170a97-f37e-4154-88e4-12f5b4bc5ce1 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:44.709660 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-12170a97-f37e-4154-88e4-12f5b4bc5ce1 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:44.710442 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-12170a97-f37e-4154-88e4-12f5b4bc5ce1 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:44.710874 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-12170a97-f37e-4154-88e4-12f5b4bc5ce1 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:44.715225 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG dbcounter [-] [117987] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=117987) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:36:44.865355 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-12170a97-f37e-4154-88e4-12f5b4bc5ce1 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a8c2a9145ac48fd8ddf2f5f76cc6425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d960c42bd04476bd6f9b83ae7a2fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:44.873520 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-12170a97-f37e-4154-88e4-12f5b4bc5ce1 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] 10.222.0.23 "GET /compute/v2.1/servers/f92d789f-e61f-428b-9898-4debd69b8c71" status: 200 len: 1314 microversion: 2.1 time: 0.175825 Jul 12 13:36:44.874213 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 390/793] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:36:44 2022] GET /compute/v2.1/servers/f92d789f-e61f-428b-9898-4debd69b8c71 => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:36:45.708142 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-4b883853-446a-4f0d-a957-3ca69d204cb3 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:36:45.709037 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-4b883853-446a-4f0d-a957-3ca69d204cb3 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] [instance: d44a95a1-4af4-48df-9d5b-5b0d927418f1] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:36:45.711313 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-2a2fdf83-082c-450f-b12e-7838eaabea29 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:36:45.711921 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-2a2fdf83-082c-450f-b12e-7838eaabea29 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 90cd5e2a-127d-4329-93ff-1a8dc66cf049] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:36:45.715661 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-4b883853-446a-4f0d-a957-3ca69d204cb3 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:45.716286 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-4b883853-446a-4f0d-a957-3ca69d204cb3 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:45.717071 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-4b883853-446a-4f0d-a957-3ca69d204cb3 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:45.717589 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-4b883853-446a-4f0d-a957-3ca69d204cb3 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:45.718620 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-2a2fdf83-082c-450f-b12e-7838eaabea29 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:45.719067 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-2a2fdf83-082c-450f-b12e-7838eaabea29 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:45.721702 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-2a2fdf83-082c-450f-b12e-7838eaabea29 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:45.721702 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-2a2fdf83-082c-450f-b12e-7838eaabea29 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:45.930773 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-4b883853-446a-4f0d-a957-3ca69d204cb3 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa0b8a0b7ff4eb0b13fb985dc0d710a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3897c86b8c847ea9091f3c7ad344fa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:45.945707 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-4b883853-446a-4f0d-a957-3ca69d204cb3 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] 10.222.0.23 "GET /compute/v2.1/servers/d44a95a1-4af4-48df-9d5b-5b0d927418f1" status: 200 len: 1279 microversion: 2.1 time: 0.241887 Jul 12 13:36:45.946780 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 404/794] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:36:45 2022] GET /compute/v2.1/servers/d44a95a1-4af4-48df-9d5b-5b0d927418f1 => generated 1279 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:36:45.957205 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-d11bc34a-bd21-4d79-831c-97f5ca754da8 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:36:45.958737 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-d11bc34a-bd21-4d79-831c-97f5ca754da8 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] [instance: f92d789f-e61f-428b-9898-4debd69b8c71] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:36:45.968603 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-d11bc34a-bd21-4d79-831c-97f5ca754da8 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:45.969159 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-d11bc34a-bd21-4d79-831c-97f5ca754da8 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:45.970057 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-d11bc34a-bd21-4d79-831c-97f5ca754da8 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:45.971111 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-d11bc34a-bd21-4d79-831c-97f5ca754da8 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:45.980306 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-2a2fdf83-082c-450f-b12e-7838eaabea29 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:45.990822 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-2a2fdf83-082c-450f-b12e-7838eaabea29 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:45.992752 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-2a2fdf83-082c-450f-b12e-7838eaabea29 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:45.994283 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-2a2fdf83-082c-450f-b12e-7838eaabea29 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/90cd5e2a-127d-4329-93ff-1a8dc66cf049" status: 200 len: 1729 microversion: 2.20 time: 0.286803 Jul 12 13:36:45.995379 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 391/795] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:36:45 2022] GET /compute/v2.1/servers/90cd5e2a-127d-4329-93ff-1a8dc66cf049 => generated 1729 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 13:36:46.134215 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-d11bc34a-bd21-4d79-831c-97f5ca754da8 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a8c2a9145ac48fd8ddf2f5f76cc6425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d960c42bd04476bd6f9b83ae7a2fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:46.142281 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-d11bc34a-bd21-4d79-831c-97f5ca754da8 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] 10.222.0.23 "GET /compute/v2.1/servers/f92d789f-e61f-428b-9898-4debd69b8c71" status: 200 len: 1314 microversion: 2.1 time: 0.191175 Jul 12 13:36:46.143790 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 405/796] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:36:45 2022] GET /compute/v2.1/servers/f92d789f-e61f-428b-9898-4debd69b8c71 => generated 1314 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:36:46.962534 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-768ca537-90e4-44a0-8149-34f4c02b76fe tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:36:46.963157 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-768ca537-90e4-44a0-8149-34f4c02b76fe tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] [instance: d44a95a1-4af4-48df-9d5b-5b0d927418f1] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:36:46.969750 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-768ca537-90e4-44a0-8149-34f4c02b76fe tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:46.970201 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-768ca537-90e4-44a0-8149-34f4c02b76fe tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:46.970984 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-768ca537-90e4-44a0-8149-34f4c02b76fe tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:46.971418 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-768ca537-90e4-44a0-8149-34f4c02b76fe tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:47.012853 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-0ddb3da8-32ce-440d-9666-018894dc7baf tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:36:47.013628 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-0ddb3da8-32ce-440d-9666-018894dc7baf tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 90cd5e2a-127d-4329-93ff-1a8dc66cf049] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:36:47.020893 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-0ddb3da8-32ce-440d-9666-018894dc7baf tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:47.021317 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-0ddb3da8-32ce-440d-9666-018894dc7baf tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:47.022269 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-0ddb3da8-32ce-440d-9666-018894dc7baf tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:47.022798 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-0ddb3da8-32ce-440d-9666-018894dc7baf tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:47.199832 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-768ca537-90e4-44a0-8149-34f4c02b76fe tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa0b8a0b7ff4eb0b13fb985dc0d710a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3897c86b8c847ea9091f3c7ad344fa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:47.208325 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-768ca537-90e4-44a0-8149-34f4c02b76fe tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] 10.222.0.23 "GET /compute/v2.1/servers/d44a95a1-4af4-48df-9d5b-5b0d927418f1" status: 200 len: 1279 microversion: 2.1 time: 0.249512 Jul 12 13:36:47.208931 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 392/797] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:36:46 2022] GET /compute/v2.1/servers/d44a95a1-4af4-48df-9d5b-5b0d927418f1 => generated 1279 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:36:47.215286 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-ceae490f-e361-498b-97b1-963cd4a64ca2 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:36:47.217048 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-ceae490f-e361-498b-97b1-963cd4a64ca2 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] [instance: f92d789f-e61f-428b-9898-4debd69b8c71] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:36:47.226741 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-ceae490f-e361-498b-97b1-963cd4a64ca2 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:47.227898 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-ceae490f-e361-498b-97b1-963cd4a64ca2 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:47.229611 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-ceae490f-e361-498b-97b1-963cd4a64ca2 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:47.230444 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-ceae490f-e361-498b-97b1-963cd4a64ca2 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:47.240713 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-0ddb3da8-32ce-440d-9666-018894dc7baf tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:47.255964 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-0ddb3da8-32ce-440d-9666-018894dc7baf tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:47.257606 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-0ddb3da8-32ce-440d-9666-018894dc7baf tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:47.258839 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-0ddb3da8-32ce-440d-9666-018894dc7baf tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/90cd5e2a-127d-4329-93ff-1a8dc66cf049" status: 200 len: 1729 microversion: 2.20 time: 0.249860 Jul 12 13:36:47.259696 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 406/798] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:36:47 2022] GET /compute/v2.1/servers/90cd5e2a-127d-4329-93ff-1a8dc66cf049 => generated 1729 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:36:47.411456 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-ceae490f-e361-498b-97b1-963cd4a64ca2 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a8c2a9145ac48fd8ddf2f5f76cc6425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d960c42bd04476bd6f9b83ae7a2fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:47.422125 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-ceae490f-e361-498b-97b1-963cd4a64ca2 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] 10.222.0.23 "GET /compute/v2.1/servers/f92d789f-e61f-428b-9898-4debd69b8c71" status: 200 len: 1314 microversion: 2.1 time: 0.212086 Jul 12 13:36:47.422719 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 393/799] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:36:47 2022] GET /compute/v2.1/servers/f92d789f-e61f-428b-9898-4debd69b8c71 => generated 1314 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:36:48.226047 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-89066948-d905-47c5-89a7-0b587b586245 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:36:48.226705 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-89066948-d905-47c5-89a7-0b587b586245 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] [instance: d44a95a1-4af4-48df-9d5b-5b0d927418f1] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:36:48.233402 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-89066948-d905-47c5-89a7-0b587b586245 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:48.233866 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-89066948-d905-47c5-89a7-0b587b586245 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:48.234638 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-89066948-d905-47c5-89a7-0b587b586245 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:48.235075 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-89066948-d905-47c5-89a7-0b587b586245 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:48.278253 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-71377a75-a0a4-4567-a5b8-3ed7c58e5cf2 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:36:48.279151 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-71377a75-a0a4-4567-a5b8-3ed7c58e5cf2 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 90cd5e2a-127d-4329-93ff-1a8dc66cf049] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:36:48.285879 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-71377a75-a0a4-4567-a5b8-3ed7c58e5cf2 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:48.286385 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-71377a75-a0a4-4567-a5b8-3ed7c58e5cf2 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:48.287158 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-71377a75-a0a4-4567-a5b8-3ed7c58e5cf2 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:48.287584 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-71377a75-a0a4-4567-a5b8-3ed7c58e5cf2 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:48.427438 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-89066948-d905-47c5-89a7-0b587b586245 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa0b8a0b7ff4eb0b13fb985dc0d710a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3897c86b8c847ea9091f3c7ad344fa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:48.435198 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-89066948-d905-47c5-89a7-0b587b586245 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] 10.222.0.23 "GET /compute/v2.1/servers/d44a95a1-4af4-48df-9d5b-5b0d927418f1" status: 200 len: 1279 microversion: 2.1 time: 0.212943 Jul 12 13:36:48.435889 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 407/800] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:36:48 2022] GET /compute/v2.1/servers/d44a95a1-4af4-48df-9d5b-5b0d927418f1 => generated 1279 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:36:48.442063 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-8cf71375-99cc-4959-9711-6928d4524658 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:36:48.442063 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-8cf71375-99cc-4959-9711-6928d4524658 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] [instance: f92d789f-e61f-428b-9898-4debd69b8c71] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:36:48.448434 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-8cf71375-99cc-4959-9711-6928d4524658 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:48.448954 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-8cf71375-99cc-4959-9711-6928d4524658 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:48.449905 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-8cf71375-99cc-4959-9711-6928d4524658 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:48.450334 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-8cf71375-99cc-4959-9711-6928d4524658 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:48.458435 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-71377a75-a0a4-4567-a5b8-3ed7c58e5cf2 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:48.466546 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-71377a75-a0a4-4567-a5b8-3ed7c58e5cf2 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:48.468050 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-71377a75-a0a4-4567-a5b8-3ed7c58e5cf2 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:48.469218 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-71377a75-a0a4-4567-a5b8-3ed7c58e5cf2 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/90cd5e2a-127d-4329-93ff-1a8dc66cf049" status: 200 len: 1729 microversion: 2.20 time: 0.194973 Jul 12 13:36:48.469814 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 394/801] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:36:48 2022] GET /compute/v2.1/servers/90cd5e2a-127d-4329-93ff-1a8dc66cf049 => generated 1729 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 13:36:48.583468 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-8cf71375-99cc-4959-9711-6928d4524658 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a8c2a9145ac48fd8ddf2f5f76cc6425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d960c42bd04476bd6f9b83ae7a2fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:48.593001 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-8cf71375-99cc-4959-9711-6928d4524658 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] 10.222.0.23 "GET /compute/v2.1/servers/f92d789f-e61f-428b-9898-4debd69b8c71" status: 200 len: 1314 microversion: 2.1 time: 0.156059 Jul 12 13:36:48.593620 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 408/802] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:36:48 2022] GET /compute/v2.1/servers/f92d789f-e61f-428b-9898-4debd69b8c71 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:36:49.452717 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-d4b40a83-dd37-4321-b8f0-1f8d1dcf31f1 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:36:49.453276 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-d4b40a83-dd37-4321-b8f0-1f8d1dcf31f1 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] [instance: d44a95a1-4af4-48df-9d5b-5b0d927418f1] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:36:49.459877 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-d4b40a83-dd37-4321-b8f0-1f8d1dcf31f1 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:49.460317 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-d4b40a83-dd37-4321-b8f0-1f8d1dcf31f1 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:49.461076 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-d4b40a83-dd37-4321-b8f0-1f8d1dcf31f1 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:49.461541 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-d4b40a83-dd37-4321-b8f0-1f8d1dcf31f1 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:49.489636 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-920b3d7c-29bc-45fd-b521-19ae886bffdf tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:36:49.490250 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-920b3d7c-29bc-45fd-b521-19ae886bffdf tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 90cd5e2a-127d-4329-93ff-1a8dc66cf049] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:36:49.496442 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-920b3d7c-29bc-45fd-b521-19ae886bffdf tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:49.497078 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-920b3d7c-29bc-45fd-b521-19ae886bffdf tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:49.497885 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-920b3d7c-29bc-45fd-b521-19ae886bffdf tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:49.498321 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-920b3d7c-29bc-45fd-b521-19ae886bffdf tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:49.656506 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-d4b40a83-dd37-4321-b8f0-1f8d1dcf31f1 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa0b8a0b7ff4eb0b13fb985dc0d710a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3897c86b8c847ea9091f3c7ad344fa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:49.664601 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-d4b40a83-dd37-4321-b8f0-1f8d1dcf31f1 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] 10.222.0.23 "GET /compute/v2.1/servers/d44a95a1-4af4-48df-9d5b-5b0d927418f1" status: 200 len: 1279 microversion: 2.1 time: 0.215728 Jul 12 13:36:49.665194 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 395/803] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:36:49 2022] GET /compute/v2.1/servers/d44a95a1-4af4-48df-9d5b-5b0d927418f1 => generated 1279 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:36:49.670037 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-b54f6b43-9b11-4a91-a336-6ebc26fb1d4f tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:36:49.670646 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-b54f6b43-9b11-4a91-a336-6ebc26fb1d4f tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] [instance: f92d789f-e61f-428b-9898-4debd69b8c71] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:36:49.677696 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-b54f6b43-9b11-4a91-a336-6ebc26fb1d4f tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:49.678143 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-b54f6b43-9b11-4a91-a336-6ebc26fb1d4f tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:49.678915 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-b54f6b43-9b11-4a91-a336-6ebc26fb1d4f tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:49.679347 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-b54f6b43-9b11-4a91-a336-6ebc26fb1d4f tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:49.686708 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-920b3d7c-29bc-45fd-b521-19ae886bffdf tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:49.695345 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-920b3d7c-29bc-45fd-b521-19ae886bffdf tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:49.696944 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-920b3d7c-29bc-45fd-b521-19ae886bffdf tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:49.698227 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-920b3d7c-29bc-45fd-b521-19ae886bffdf tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/90cd5e2a-127d-4329-93ff-1a8dc66cf049" status: 200 len: 1729 microversion: 2.20 time: 0.214426 Jul 12 13:36:49.698795 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 409/804] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:36:49 2022] GET /compute/v2.1/servers/90cd5e2a-127d-4329-93ff-1a8dc66cf049 => generated 1729 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:36:49.824690 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-b54f6b43-9b11-4a91-a336-6ebc26fb1d4f tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a8c2a9145ac48fd8ddf2f5f76cc6425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d960c42bd04476bd6f9b83ae7a2fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:49.833708 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-b54f6b43-9b11-4a91-a336-6ebc26fb1d4f tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] 10.222.0.23 "GET /compute/v2.1/servers/f92d789f-e61f-428b-9898-4debd69b8c71" status: 200 len: 1314 microversion: 2.1 time: 0.167419 Jul 12 13:36:49.834284 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 396/805] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:36:49 2022] GET /compute/v2.1/servers/f92d789f-e61f-428b-9898-4debd69b8c71 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:36:50.681759 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-0095f549-912f-46d7-9495-0a3aca877035 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:36:50.682376 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-0095f549-912f-46d7-9495-0a3aca877035 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] [instance: d44a95a1-4af4-48df-9d5b-5b0d927418f1] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:36:50.688984 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-0095f549-912f-46d7-9495-0a3aca877035 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:50.689622 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-0095f549-912f-46d7-9495-0a3aca877035 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:50.690540 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-0095f549-912f-46d7-9495-0a3aca877035 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:50.690977 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-0095f549-912f-46d7-9495-0a3aca877035 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:50.718249 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-2459e275-7fd4-45c3-b302-4c309a443f1e tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:36:50.718837 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-2459e275-7fd4-45c3-b302-4c309a443f1e tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 90cd5e2a-127d-4329-93ff-1a8dc66cf049] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:36:50.726349 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-2459e275-7fd4-45c3-b302-4c309a443f1e tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:50.726789 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-2459e275-7fd4-45c3-b302-4c309a443f1e tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:50.727816 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-2459e275-7fd4-45c3-b302-4c309a443f1e tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:50.728246 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-2459e275-7fd4-45c3-b302-4c309a443f1e tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:50.885248 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-0095f549-912f-46d7-9495-0a3aca877035 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa0b8a0b7ff4eb0b13fb985dc0d710a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3897c86b8c847ea9091f3c7ad344fa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:50.897002 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-0095f549-912f-46d7-9495-0a3aca877035 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] 10.222.0.23 "GET /compute/v2.1/servers/d44a95a1-4af4-48df-9d5b-5b0d927418f1" status: 200 len: 1279 microversion: 2.1 time: 0.219151 Jul 12 13:36:50.897734 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 410/806] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:36:50 2022] GET /compute/v2.1/servers/d44a95a1-4af4-48df-9d5b-5b0d927418f1 => generated 1279 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:36:50.902420 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-362fce17-94c5-4af1-a2d1-783288ddcfae tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:36:50.903131 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-362fce17-94c5-4af1-a2d1-783288ddcfae tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] [instance: f92d789f-e61f-428b-9898-4debd69b8c71] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:36:50.912117 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-362fce17-94c5-4af1-a2d1-783288ddcfae tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:50.912568 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-362fce17-94c5-4af1-a2d1-783288ddcfae tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:50.913349 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-362fce17-94c5-4af1-a2d1-783288ddcfae tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:50.913812 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-362fce17-94c5-4af1-a2d1-783288ddcfae tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:50.914375 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-2459e275-7fd4-45c3-b302-4c309a443f1e tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:50.916624 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG dbcounter [-] [117988] Writing DB stats nova_cell1:SELECT=100 {{(pid=117988) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:36:50.923451 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-2459e275-7fd4-45c3-b302-4c309a443f1e tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:50.925035 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-2459e275-7fd4-45c3-b302-4c309a443f1e tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:50.926382 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-2459e275-7fd4-45c3-b302-4c309a443f1e tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/90cd5e2a-127d-4329-93ff-1a8dc66cf049" status: 200 len: 1729 microversion: 2.20 time: 0.213098 Jul 12 13:36:50.926950 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 397/807] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:36:50 2022] GET /compute/v2.1/servers/90cd5e2a-127d-4329-93ff-1a8dc66cf049 => generated 1729 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:36:51.051380 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-362fce17-94c5-4af1-a2d1-783288ddcfae tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a8c2a9145ac48fd8ddf2f5f76cc6425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d960c42bd04476bd6f9b83ae7a2fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:51.058935 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-362fce17-94c5-4af1-a2d1-783288ddcfae tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] 10.222.0.23 "GET /compute/v2.1/servers/f92d789f-e61f-428b-9898-4debd69b8c71" status: 200 len: 1314 microversion: 2.1 time: 0.160131 Jul 12 13:36:51.059515 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 411/808] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:36:50 2022] GET /compute/v2.1/servers/f92d789f-e61f-428b-9898-4debd69b8c71 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:36:51.914390 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-e37e2b3f-d6fb-4c70-92b1-b7315473120e tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:36:51.914999 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-e37e2b3f-d6fb-4c70-92b1-b7315473120e tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] [instance: d44a95a1-4af4-48df-9d5b-5b0d927418f1] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:36:51.921631 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-e37e2b3f-d6fb-4c70-92b1-b7315473120e tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:51.922082 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-e37e2b3f-d6fb-4c70-92b1-b7315473120e tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:51.922854 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-e37e2b3f-d6fb-4c70-92b1-b7315473120e tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:51.923293 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-e37e2b3f-d6fb-4c70-92b1-b7315473120e tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:51.944964 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-d32607d7-b846-49d8-aa9d-8527592bbcea tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:36:51.945643 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-d32607d7-b846-49d8-aa9d-8527592bbcea tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 90cd5e2a-127d-4329-93ff-1a8dc66cf049] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:36:51.952127 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-d32607d7-b846-49d8-aa9d-8527592bbcea tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:51.952581 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-d32607d7-b846-49d8-aa9d-8527592bbcea tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:51.953355 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-d32607d7-b846-49d8-aa9d-8527592bbcea tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:51.953815 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-d32607d7-b846-49d8-aa9d-8527592bbcea tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:52.121280 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-e37e2b3f-d6fb-4c70-92b1-b7315473120e tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa0b8a0b7ff4eb0b13fb985dc0d710a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3897c86b8c847ea9091f3c7ad344fa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:52.129400 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-e37e2b3f-d6fb-4c70-92b1-b7315473120e tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] 10.222.0.23 "GET /compute/v2.1/servers/d44a95a1-4af4-48df-9d5b-5b0d927418f1" status: 200 len: 1279 microversion: 2.1 time: 0.218782 Jul 12 13:36:52.130271 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 398/809] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:36:51 2022] GET /compute/v2.1/servers/d44a95a1-4af4-48df-9d5b-5b0d927418f1 => generated 1279 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:36:52.136316 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-f63043b1-447a-46cb-b2e3-8da668a19c2b tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:36:52.137013 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-f63043b1-447a-46cb-b2e3-8da668a19c2b tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] [instance: f92d789f-e61f-428b-9898-4debd69b8c71] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:36:52.143747 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-f63043b1-447a-46cb-b2e3-8da668a19c2b tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:52.144189 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-f63043b1-447a-46cb-b2e3-8da668a19c2b tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:52.144857 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-d32607d7-b846-49d8-aa9d-8527592bbcea tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:52.145015 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-f63043b1-447a-46cb-b2e3-8da668a19c2b tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:52.145396 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-f63043b1-447a-46cb-b2e3-8da668a19c2b tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:52.153328 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-d32607d7-b846-49d8-aa9d-8527592bbcea tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:52.154885 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-d32607d7-b846-49d8-aa9d-8527592bbcea tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:52.156062 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-d32607d7-b846-49d8-aa9d-8527592bbcea tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/90cd5e2a-127d-4329-93ff-1a8dc66cf049" status: 200 len: 1729 microversion: 2.20 time: 0.215178 Jul 12 13:36:52.156633 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 412/810] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:36:51 2022] GET /compute/v2.1/servers/90cd5e2a-127d-4329-93ff-1a8dc66cf049 => generated 1729 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 13:36:52.283865 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-f63043b1-447a-46cb-b2e3-8da668a19c2b tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a8c2a9145ac48fd8ddf2f5f76cc6425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d960c42bd04476bd6f9b83ae7a2fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:52.291641 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-f63043b1-447a-46cb-b2e3-8da668a19c2b tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] 10.222.0.23 "GET /compute/v2.1/servers/f92d789f-e61f-428b-9898-4debd69b8c71" status: 200 len: 1314 microversion: 2.1 time: 0.159987 Jul 12 13:36:52.292219 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 399/811] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:36:52 2022] GET /compute/v2.1/servers/f92d789f-e61f-428b-9898-4debd69b8c71 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:36:53.147103 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-3984e0d5-7d50-4834-ae88-dd60b2c5aafd tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:36:53.147654 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-3984e0d5-7d50-4834-ae88-dd60b2c5aafd tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] [instance: d44a95a1-4af4-48df-9d5b-5b0d927418f1] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:36:53.154200 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-3984e0d5-7d50-4834-ae88-dd60b2c5aafd tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:53.154645 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-3984e0d5-7d50-4834-ae88-dd60b2c5aafd tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:53.155404 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-3984e0d5-7d50-4834-ae88-dd60b2c5aafd tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:53.155831 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-3984e0d5-7d50-4834-ae88-dd60b2c5aafd tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:53.175008 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-031ed6b3-728d-4a95-b693-b5e98b490dcf tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:36:53.175733 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-031ed6b3-728d-4a95-b693-b5e98b490dcf tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 90cd5e2a-127d-4329-93ff-1a8dc66cf049] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:36:53.182099 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-031ed6b3-728d-4a95-b693-b5e98b490dcf tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:53.182544 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-031ed6b3-728d-4a95-b693-b5e98b490dcf tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:53.183318 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-031ed6b3-728d-4a95-b693-b5e98b490dcf tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:53.183752 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-031ed6b3-728d-4a95-b693-b5e98b490dcf tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:53.350381 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-3984e0d5-7d50-4834-ae88-dd60b2c5aafd tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa0b8a0b7ff4eb0b13fb985dc0d710a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3897c86b8c847ea9091f3c7ad344fa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:53.358145 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-3984e0d5-7d50-4834-ae88-dd60b2c5aafd tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] 10.222.0.23 "GET /compute/v2.1/servers/d44a95a1-4af4-48df-9d5b-5b0d927418f1" status: 200 len: 1279 microversion: 2.1 time: 0.215199 Jul 12 13:36:53.358729 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 413/812] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:36:53 2022] GET /compute/v2.1/servers/d44a95a1-4af4-48df-9d5b-5b0d927418f1 => generated 1279 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:36:53.364275 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-5d41634d-5da2-42da-a345-20983f6dd7e3 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:36:53.364902 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-5d41634d-5da2-42da-a345-20983f6dd7e3 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] [instance: f92d789f-e61f-428b-9898-4debd69b8c71] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:36:53.371294 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-5d41634d-5da2-42da-a345-20983f6dd7e3 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:53.373354 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-5d41634d-5da2-42da-a345-20983f6dd7e3 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:53.373354 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-5d41634d-5da2-42da-a345-20983f6dd7e3 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:53.373354 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-5d41634d-5da2-42da-a345-20983f6dd7e3 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:53.382423 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-031ed6b3-728d-4a95-b693-b5e98b490dcf tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:53.390799 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-031ed6b3-728d-4a95-b693-b5e98b490dcf tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:53.392322 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-031ed6b3-728d-4a95-b693-b5e98b490dcf tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:53.394865 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-031ed6b3-728d-4a95-b693-b5e98b490dcf tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/90cd5e2a-127d-4329-93ff-1a8dc66cf049" status: 200 len: 1729 microversion: 2.20 time: 0.224412 Jul 12 13:36:53.395492 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 400/813] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:36:53 2022] GET /compute/v2.1/servers/90cd5e2a-127d-4329-93ff-1a8dc66cf049 => generated 1729 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 13:36:53.548059 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-5d41634d-5da2-42da-a345-20983f6dd7e3 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a8c2a9145ac48fd8ddf2f5f76cc6425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d960c42bd04476bd6f9b83ae7a2fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:53.555936 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-5d41634d-5da2-42da-a345-20983f6dd7e3 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] 10.222.0.23 "GET /compute/v2.1/servers/f92d789f-e61f-428b-9898-4debd69b8c71" status: 200 len: 1314 microversion: 2.1 time: 0.196104 Jul 12 13:36:53.556531 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 414/814] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:36:53 2022] GET /compute/v2.1/servers/f92d789f-e61f-428b-9898-4debd69b8c71 => generated 1314 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:36:54.082178 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-99496971-9f1b-43dd-991b-a9f5f9ce7390 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:36:54.083327 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-99496971-9f1b-43dd-991b-a9f5f9ce7390 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] [instance: a4c23b11-fc12-4dd8-8a9c-9019f9e101c9] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:36:54.089935 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-99496971-9f1b-43dd-991b-a9f5f9ce7390 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:54.090544 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-99496971-9f1b-43dd-991b-a9f5f9ce7390 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:54.091470 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-99496971-9f1b-43dd-991b-a9f5f9ce7390 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:54.091741 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-99496971-9f1b-43dd-991b-a9f5f9ce7390 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:54.124701 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-99496971-9f1b-43dd-991b-a9f5f9ce7390 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] 10.222.0.23 "GET /compute/v2.1/servers/a4c23b11-fc12-4dd8-8a9c-9019f9e101c9/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047707 Jul 12 13:36:54.125292 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 401/815] 10.222.0.23 () {58 vars in 1301 bytes} [Tue Jul 12 13:36:54 2022] GET /compute/v2.1/servers/a4c23b11-fc12-4dd8-8a9c-9019f9e101c9/os-volume_attachments => generated 371 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:36:54.242926 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-8fee7a36-9e08-4133-913c-9a86337cbf80 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:36:54.243698 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-8fee7a36-9e08-4133-913c-9a86337cbf80 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] [instance: a4c23b11-fc12-4dd8-8a9c-9019f9e101c9] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:36:54.251067 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-8fee7a36-9e08-4133-913c-9a86337cbf80 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:54.251541 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-8fee7a36-9e08-4133-913c-9a86337cbf80 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:54.252972 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-8fee7a36-9e08-4133-913c-9a86337cbf80 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:54.253463 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-8fee7a36-9e08-4133-913c-9a86337cbf80 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:54.284322 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-8fee7a36-9e08-4133-913c-9a86337cbf80 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] 10.222.0.23 "GET /compute/v2.1/servers/a4c23b11-fc12-4dd8-8a9c-9019f9e101c9/os-volume_attachments/6d03df11-b3f3-463a-94cb-abf81670da9a" status: 200 len: 194 microversion: 2.1 time: 0.045534 Jul 12 13:36:54.284957 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 415/816] 10.222.0.23 () {58 vars in 1412 bytes} [Tue Jul 12 13:36:54 2022] GET /compute/v2.1/servers/a4c23b11-fc12-4dd8-8a9c-9019f9e101c9/os-volume_attachments/6d03df11-b3f3-463a-94cb-abf81670da9a => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 13:36:54.294585 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-50da95bd-5f59-43dc-a354-f3e81fc96b15 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:36:54.295162 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-50da95bd-5f59-43dc-a354-f3e81fc96b15 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] [instance: a4c23b11-fc12-4dd8-8a9c-9019f9e101c9] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:36:54.302519 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-50da95bd-5f59-43dc-a354-f3e81fc96b15 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:54.302909 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-50da95bd-5f59-43dc-a354-f3e81fc96b15 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:54.303687 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-50da95bd-5f59-43dc-a354-f3e81fc96b15 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:54.304126 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-50da95bd-5f59-43dc-a354-f3e81fc96b15 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:54.381694 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-74da09cc-c312-42da-a198-08dac41fac19 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:36:54.382839 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-74da09cc-c312-42da-a198-08dac41fac19 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] [instance: d44a95a1-4af4-48df-9d5b-5b0d927418f1] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:36:54.390121 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-74da09cc-c312-42da-a198-08dac41fac19 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:54.390330 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.objects.instance [None req-50da95bd-5f59-43dc-a354-f3e81fc96b15 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lazy-loading 'services' on Instance uuid a4c23b11-fc12-4dd8-8a9c-9019f9e101c9 {{(pid=117987) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 13:36:54.390602 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-74da09cc-c312-42da-a198-08dac41fac19 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:54.391414 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-74da09cc-c312-42da-a198-08dac41fac19 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:54.391878 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-74da09cc-c312-42da-a198-08dac41fac19 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:54.478022 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-50da95bd-5f59-43dc-a354-f3e81fc96b15 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] 10.222.0.23 "DELETE /compute/v2.1/servers/a4c23b11-fc12-4dd8-8a9c-9019f9e101c9/os-volume_attachments/6d03df11-b3f3-463a-94cb-abf81670da9a" status: 202 len: 0 microversion: 2.1 time: 0.187070 Jul 12 13:36:54.478805 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 402/817] 10.222.0.23 () {58 vars in 1415 bytes} [Tue Jul 12 13:36:54 2022] DELETE /compute/v2.1/servers/a4c23b11-fc12-4dd8-8a9c-9019f9e101c9/os-volume_attachments/6d03df11-b3f3-463a-94cb-abf81670da9a => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 13:36:54.485214 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-8bf4a1bd-6175-4679-b031-cecaf3c7c11c tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:36:54.485941 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-8bf4a1bd-6175-4679-b031-cecaf3c7c11c tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 90cd5e2a-127d-4329-93ff-1a8dc66cf049] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:36:54.495901 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-8bf4a1bd-6175-4679-b031-cecaf3c7c11c tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:54.496361 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-8bf4a1bd-6175-4679-b031-cecaf3c7c11c tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:54.497144 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-8bf4a1bd-6175-4679-b031-cecaf3c7c11c tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:54.497629 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-8bf4a1bd-6175-4679-b031-cecaf3c7c11c tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:54.576308 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-74da09cc-c312-42da-a198-08dac41fac19 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa0b8a0b7ff4eb0b13fb985dc0d710a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3897c86b8c847ea9091f3c7ad344fa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:54.587140 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-74da09cc-c312-42da-a198-08dac41fac19 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] 10.222.0.23 "GET /compute/v2.1/servers/d44a95a1-4af4-48df-9d5b-5b0d927418f1" status: 200 len: 1279 microversion: 2.1 time: 0.209956 Jul 12 13:36:54.597480 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 416/818] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:36:54 2022] GET /compute/v2.1/servers/d44a95a1-4af4-48df-9d5b-5b0d927418f1 => generated 1279 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:36:54.602699 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-1ae707e4-2f2e-41d1-b8f3-33ed2fd1d09b tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:36:54.603628 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-1ae707e4-2f2e-41d1-b8f3-33ed2fd1d09b tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] [instance: f92d789f-e61f-428b-9898-4debd69b8c71] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:36:54.606772 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG dbcounter [-] [117988] Writing DB stats nova_api:SELECT=100 {{(pid=117988) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:36:54.610803 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-1ae707e4-2f2e-41d1-b8f3-33ed2fd1d09b tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:54.612111 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-1ae707e4-2f2e-41d1-b8f3-33ed2fd1d09b tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:54.613054 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-1ae707e4-2f2e-41d1-b8f3-33ed2fd1d09b tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:54.613716 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-1ae707e4-2f2e-41d1-b8f3-33ed2fd1d09b tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:54.739847 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-8bf4a1bd-6175-4679-b031-cecaf3c7c11c tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:54.749623 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-8bf4a1bd-6175-4679-b031-cecaf3c7c11c tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:54.751151 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-8bf4a1bd-6175-4679-b031-cecaf3c7c11c tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:54.753784 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-8bf4a1bd-6175-4679-b031-cecaf3c7c11c tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/90cd5e2a-127d-4329-93ff-1a8dc66cf049" status: 200 len: 1729 microversion: 2.20 time: 0.273625 Jul 12 13:36:54.754367 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 403/819] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:36:54 2022] GET /compute/v2.1/servers/90cd5e2a-127d-4329-93ff-1a8dc66cf049 => generated 1729 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:36:54.810581 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-1ae707e4-2f2e-41d1-b8f3-33ed2fd1d09b tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a8c2a9145ac48fd8ddf2f5f76cc6425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d960c42bd04476bd6f9b83ae7a2fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:54.818552 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-1ae707e4-2f2e-41d1-b8f3-33ed2fd1d09b tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] 10.222.0.23 "GET /compute/v2.1/servers/f92d789f-e61f-428b-9898-4debd69b8c71" status: 200 len: 1314 microversion: 2.1 time: 0.219788 Jul 12 13:36:54.819133 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 417/820] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:36:54 2022] GET /compute/v2.1/servers/f92d789f-e61f-428b-9898-4debd69b8c71 => generated 1314 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:36:55.603918 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-faca540e-8d18-47ab-952c-2db93a5a4c3a tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:36:55.604556 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-faca540e-8d18-47ab-952c-2db93a5a4c3a tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] [instance: d44a95a1-4af4-48df-9d5b-5b0d927418f1] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:36:55.611001 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-faca540e-8d18-47ab-952c-2db93a5a4c3a tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:55.611654 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-faca540e-8d18-47ab-952c-2db93a5a4c3a tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:55.612515 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-faca540e-8d18-47ab-952c-2db93a5a4c3a tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:55.612950 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-faca540e-8d18-47ab-952c-2db93a5a4c3a tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:55.756112 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-faca540e-8d18-47ab-952c-2db93a5a4c3a tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa0b8a0b7ff4eb0b13fb985dc0d710a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3897c86b8c847ea9091f3c7ad344fa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:55.763779 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-faca540e-8d18-47ab-952c-2db93a5a4c3a tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] 10.222.0.23 "GET /compute/v2.1/servers/d44a95a1-4af4-48df-9d5b-5b0d927418f1" status: 200 len: 1267 microversion: 2.1 time: 0.163615 Jul 12 13:36:55.764363 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 404/821] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:36:55 2022] GET /compute/v2.1/servers/d44a95a1-4af4-48df-9d5b-5b0d927418f1 => generated 1267 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:36:55.773942 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-a3f8c2b5-f19b-40f9-98e5-586091055722 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:36:55.774585 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-a3f8c2b5-f19b-40f9-98e5-586091055722 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 90cd5e2a-127d-4329-93ff-1a8dc66cf049] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:36:55.781123 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-a3f8c2b5-f19b-40f9-98e5-586091055722 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:55.781602 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-a3f8c2b5-f19b-40f9-98e5-586091055722 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:55.782369 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-a3f8c2b5-f19b-40f9-98e5-586091055722 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:55.782797 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-a3f8c2b5-f19b-40f9-98e5-586091055722 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:55.838209 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-45027a38-5e46-4223-af9c-a231ea2187e2 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:36:55.838738 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-45027a38-5e46-4223-af9c-a231ea2187e2 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] [instance: f92d789f-e61f-428b-9898-4debd69b8c71] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:36:55.844857 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-45027a38-5e46-4223-af9c-a231ea2187e2 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:55.845305 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-45027a38-5e46-4223-af9c-a231ea2187e2 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:55.846180 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-45027a38-5e46-4223-af9c-a231ea2187e2 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:55.846610 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-45027a38-5e46-4223-af9c-a231ea2187e2 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:55.962767 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-a3f8c2b5-f19b-40f9-98e5-586091055722 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:55.977228 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-a3f8c2b5-f19b-40f9-98e5-586091055722 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:55.981427 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-a3f8c2b5-f19b-40f9-98e5-586091055722 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:55.982565 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-a3f8c2b5-f19b-40f9-98e5-586091055722 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/90cd5e2a-127d-4329-93ff-1a8dc66cf049" status: 200 len: 1729 microversion: 2.20 time: 0.212427 Jul 12 13:36:55.983882 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 418/822] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:36:55 2022] GET /compute/v2.1/servers/90cd5e2a-127d-4329-93ff-1a8dc66cf049 => generated 1729 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:36:56.019598 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-45027a38-5e46-4223-af9c-a231ea2187e2 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a8c2a9145ac48fd8ddf2f5f76cc6425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d960c42bd04476bd6f9b83ae7a2fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:56.027396 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-45027a38-5e46-4223-af9c-a231ea2187e2 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] 10.222.0.23 "GET /compute/v2.1/servers/f92d789f-e61f-428b-9898-4debd69b8c71" status: 200 len: 1497 microversion: 2.1 time: 0.193639 Jul 12 13:36:56.028011 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 405/823] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:36:55 2022] GET /compute/v2.1/servers/f92d789f-e61f-428b-9898-4debd69b8c71 => generated 1497 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:36:56.040398 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [req-327560a4-ea4a-4875-b372-d8278a0240ad req-072952d7-ec4b-45f4-8a4c-714464500b68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90cd5e2a-127d-4329-93ff-1a8dc66cf049", "name": "network-vif-plugged", "status": "completed", "tag": "a1218983-36f0-4e25-9df1-d8f2cdfe2972"}]} {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:36:56.055004 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [req-327560a4-ea4a-4875-b372-d8278a0240ad req-072952d7-ec4b-45f4-8a4c-714464500b68 service nova] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:56.055484 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [req-327560a4-ea4a-4875-b372-d8278a0240ad req-072952d7-ec4b-45f4-8a4c-714464500b68 service nova] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:56.072877 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.compute.server_external_events [req-327560a4-ea4a-4875-b372-d8278a0240ad req-072952d7-ec4b-45f4-8a4c-714464500b68 service nova] Creating event network-vif-plugged:a1218983-36f0-4e25-9df1-d8f2cdfe2972 for instance 90cd5e2a-127d-4329-93ff-1a8dc66cf049 on hv-cinder-82002 Jul 12 13:36:56.076074 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [req-327560a4-ea4a-4875-b372-d8278a0240ad req-072952d7-ec4b-45f4-8a4c-714464500b68 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040061 Jul 12 13:36:56.076684 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 419/824] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 12 13:36:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 13:36:56.567925 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-b0f804b5-84c5-4478-91e7-63a2d3493a5b tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:36:56.568425 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-b0f804b5-84c5-4478-91e7-63a2d3493a5b tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] [instance: f92d789f-e61f-428b-9898-4debd69b8c71] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:36:56.574701 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-b0f804b5-84c5-4478-91e7-63a2d3493a5b tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:56.575142 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-b0f804b5-84c5-4478-91e7-63a2d3493a5b tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:56.575912 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-b0f804b5-84c5-4478-91e7-63a2d3493a5b tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:56.576340 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-b0f804b5-84c5-4478-91e7-63a2d3493a5b tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:56.582694 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG dbcounter [-] [117987] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117987) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:36:56.613884 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-b0f804b5-84c5-4478-91e7-63a2d3493a5b tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] [instance: f92d789f-e61f-428b-9898-4debd69b8c71] Going to try to terminate instance {{(pid=117987) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 13:36:56.703319 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-b0f804b5-84c5-4478-91e7-63a2d3493a5b tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] 10.222.0.23 "DELETE /compute/v2.1/servers/f92d789f-e61f-428b-9898-4debd69b8c71" status: 204 len: 0 microversion: 2.1 time: 0.139951 Jul 12 13:36:56.704022 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 406/825] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 12 13:36:56 2022] DELETE /compute/v2.1/servers/f92d789f-e61f-428b-9898-4debd69b8c71 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 13:36:56.712959 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-6b49c247-6afa-4b20-9b1b-d6130a23f45e tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:36:56.713707 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-6b49c247-6afa-4b20-9b1b-d6130a23f45e tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] [instance: f92d789f-e61f-428b-9898-4debd69b8c71] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:36:56.720052 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-6b49c247-6afa-4b20-9b1b-d6130a23f45e tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:56.720838 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-6b49c247-6afa-4b20-9b1b-d6130a23f45e tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:56.721656 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-6b49c247-6afa-4b20-9b1b-d6130a23f45e tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:56.722089 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-6b49c247-6afa-4b20-9b1b-d6130a23f45e tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:56.782447 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-33507408-29c4-4361-ac76-12161f9caf3e tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:36:56.783772 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-33507408-29c4-4361-ac76-12161f9caf3e tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] [instance: d44a95a1-4af4-48df-9d5b-5b0d927418f1] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:36:56.792545 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-33507408-29c4-4361-ac76-12161f9caf3e tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:56.792545 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-33507408-29c4-4361-ac76-12161f9caf3e tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:56.792545 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-33507408-29c4-4361-ac76-12161f9caf3e tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:56.792545 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-33507408-29c4-4361-ac76-12161f9caf3e tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:56.902997 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-6b49c247-6afa-4b20-9b1b-d6130a23f45e tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a8c2a9145ac48fd8ddf2f5f76cc6425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d960c42bd04476bd6f9b83ae7a2fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:56.912558 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-6b49c247-6afa-4b20-9b1b-d6130a23f45e tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] 10.222.0.23 "GET /compute/v2.1/servers/f92d789f-e61f-428b-9898-4debd69b8c71" status: 200 len: 1503 microversion: 2.1 time: 0.203789 Jul 12 13:36:56.913471 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 420/826] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:36:56 2022] GET /compute/v2.1/servers/f92d789f-e61f-428b-9898-4debd69b8c71 => generated 1503 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:36:56.962312 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-33507408-29c4-4361-ac76-12161f9caf3e tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa0b8a0b7ff4eb0b13fb985dc0d710a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3897c86b8c847ea9091f3c7ad344fa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:56.969898 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-33507408-29c4-4361-ac76-12161f9caf3e tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] 10.222.0.23 "GET /compute/v2.1/servers/d44a95a1-4af4-48df-9d5b-5b0d927418f1" status: 200 len: 1267 microversion: 2.1 time: 0.191660 Jul 12 13:36:56.970524 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 407/827] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:36:56 2022] GET /compute/v2.1/servers/d44a95a1-4af4-48df-9d5b-5b0d927418f1 => generated 1267 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:36:57.000889 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-a11bf18f-014e-41f8-b992-acdd6fb7e1a4 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:36:57.001546 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-a11bf18f-014e-41f8-b992-acdd6fb7e1a4 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 90cd5e2a-127d-4329-93ff-1a8dc66cf049] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:36:57.008413 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-a11bf18f-014e-41f8-b992-acdd6fb7e1a4 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:57.008865 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-a11bf18f-014e-41f8-b992-acdd6fb7e1a4 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:57.009675 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-a11bf18f-014e-41f8-b992-acdd6fb7e1a4 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:57.010115 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-a11bf18f-014e-41f8-b992-acdd6fb7e1a4 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:57.151287 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-a11bf18f-014e-41f8-b992-acdd6fb7e1a4 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:57.161648 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-a11bf18f-014e-41f8-b992-acdd6fb7e1a4 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:57.163192 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-a11bf18f-014e-41f8-b992-acdd6fb7e1a4 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:57.164394 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-a11bf18f-014e-41f8-b992-acdd6fb7e1a4 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/90cd5e2a-127d-4329-93ff-1a8dc66cf049" status: 200 len: 1729 microversion: 2.20 time: 0.167442 Jul 12 13:36:57.164997 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 421/828] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:36:56 2022] GET /compute/v2.1/servers/90cd5e2a-127d-4329-93ff-1a8dc66cf049 => generated 1729 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:36:57.932758 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-1c652252-8de4-4e1c-b36c-92c2159b43ff tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:36:57.932758 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-1c652252-8de4-4e1c-b36c-92c2159b43ff tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] [instance: f92d789f-e61f-428b-9898-4debd69b8c71] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:36:57.938489 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-1c652252-8de4-4e1c-b36c-92c2159b43ff tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:57.938944 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-1c652252-8de4-4e1c-b36c-92c2159b43ff tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:57.939979 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-1c652252-8de4-4e1c-b36c-92c2159b43ff tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:57.940781 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-1c652252-8de4-4e1c-b36c-92c2159b43ff tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:57.988688 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-f09ccc50-2ae8-4c93-a020-d4c7178f064c tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:36:57.989497 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-f09ccc50-2ae8-4c93-a020-d4c7178f064c tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] [instance: d44a95a1-4af4-48df-9d5b-5b0d927418f1] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:36:57.998126 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-f09ccc50-2ae8-4c93-a020-d4c7178f064c tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:57.998764 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-f09ccc50-2ae8-4c93-a020-d4c7178f064c tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:57.999545 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-f09ccc50-2ae8-4c93-a020-d4c7178f064c tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:57.999979 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-f09ccc50-2ae8-4c93-a020-d4c7178f064c tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:58.145470 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-1c652252-8de4-4e1c-b36c-92c2159b43ff tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a8c2a9145ac48fd8ddf2f5f76cc6425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d960c42bd04476bd6f9b83ae7a2fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:58.153523 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-1c652252-8de4-4e1c-b36c-92c2159b43ff tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] 10.222.0.23 "GET /compute/v2.1/servers/f92d789f-e61f-428b-9898-4debd69b8c71" status: 200 len: 1503 microversion: 2.1 time: 0.226512 Jul 12 13:36:58.154105 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 408/829] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:36:57 2022] GET /compute/v2.1/servers/f92d789f-e61f-428b-9898-4debd69b8c71 => generated 1503 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:36:58.179882 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-f09ccc50-2ae8-4c93-a020-d4c7178f064c tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa0b8a0b7ff4eb0b13fb985dc0d710a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3897c86b8c847ea9091f3c7ad344fa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:58.183206 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-06e0225d-521f-453c-a011-461ecbf1b3c2 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:36:58.183776 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-06e0225d-521f-453c-a011-461ecbf1b3c2 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 90cd5e2a-127d-4329-93ff-1a8dc66cf049] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:36:58.187596 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-f09ccc50-2ae8-4c93-a020-d4c7178f064c tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] 10.222.0.23 "GET /compute/v2.1/servers/d44a95a1-4af4-48df-9d5b-5b0d927418f1" status: 200 len: 1267 microversion: 2.1 time: 0.203288 Jul 12 13:36:58.188184 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 422/830] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:36:57 2022] GET /compute/v2.1/servers/d44a95a1-4af4-48df-9d5b-5b0d927418f1 => generated 1267 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:36:58.190647 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-06e0225d-521f-453c-a011-461ecbf1b3c2 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:58.191017 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-06e0225d-521f-453c-a011-461ecbf1b3c2 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:58.191786 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-06e0225d-521f-453c-a011-461ecbf1b3c2 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:58.192214 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-06e0225d-521f-453c-a011-461ecbf1b3c2 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:58.329398 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-06e0225d-521f-453c-a011-461ecbf1b3c2 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:58.338190 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-06e0225d-521f-453c-a011-461ecbf1b3c2 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:58.339691 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-06e0225d-521f-453c-a011-461ecbf1b3c2 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:58.340878 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-06e0225d-521f-453c-a011-461ecbf1b3c2 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/90cd5e2a-127d-4329-93ff-1a8dc66cf049" status: 200 len: 1729 microversion: 2.20 time: 0.161553 Jul 12 13:36:58.341460 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 409/831] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:36:58 2022] GET /compute/v2.1/servers/90cd5e2a-127d-4329-93ff-1a8dc66cf049 => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 13:36:59.172030 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-d4a4eb76-ac77-43ac-b7a6-6c9803cf92ef tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:36:59.172662 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-d4a4eb76-ac77-43ac-b7a6-6c9803cf92ef tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] [instance: f92d789f-e61f-428b-9898-4debd69b8c71] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:36:59.181178 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-d4a4eb76-ac77-43ac-b7a6-6c9803cf92ef tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:59.181655 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-d4a4eb76-ac77-43ac-b7a6-6c9803cf92ef tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:59.182429 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-d4a4eb76-ac77-43ac-b7a6-6c9803cf92ef tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:59.182861 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-d4a4eb76-ac77-43ac-b7a6-6c9803cf92ef tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:59.207132 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-8b5220c3-a835-456e-a370-40e39d5ce3db tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:36:59.208951 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-8b5220c3-a835-456e-a370-40e39d5ce3db tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] [instance: d44a95a1-4af4-48df-9d5b-5b0d927418f1] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:36:59.218711 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-8b5220c3-a835-456e-a370-40e39d5ce3db tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:59.219310 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-8b5220c3-a835-456e-a370-40e39d5ce3db tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:59.220209 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-8b5220c3-a835-456e-a370-40e39d5ce3db tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:59.221138 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-8b5220c3-a835-456e-a370-40e39d5ce3db tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:59.377288 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-d4a4eb76-ac77-43ac-b7a6-6c9803cf92ef tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a8c2a9145ac48fd8ddf2f5f76cc6425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d960c42bd04476bd6f9b83ae7a2fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:59.385100 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-d4a4eb76-ac77-43ac-b7a6-6c9803cf92ef tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] 10.222.0.23 "GET /compute/v2.1/servers/f92d789f-e61f-428b-9898-4debd69b8c71" status: 200 len: 1503 microversion: 2.1 time: 0.216834 Jul 12 13:36:59.385826 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 423/832] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:36:59 2022] GET /compute/v2.1/servers/f92d789f-e61f-428b-9898-4debd69b8c71 => generated 1503 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:36:59.390514 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-8db653cb-f70e-48b1-913b-76fc7e19967a tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:36:59.391210 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-8db653cb-f70e-48b1-913b-76fc7e19967a tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 90cd5e2a-127d-4329-93ff-1a8dc66cf049] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:36:59.398011 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-8db653cb-f70e-48b1-913b-76fc7e19967a tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:59.398571 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-8db653cb-f70e-48b1-913b-76fc7e19967a tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:59.399418 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-8db653cb-f70e-48b1-913b-76fc7e19967a tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:59.399926 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-8db653cb-f70e-48b1-913b-76fc7e19967a tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:59.407669 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-8b5220c3-a835-456e-a370-40e39d5ce3db tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa0b8a0b7ff4eb0b13fb985dc0d710a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3897c86b8c847ea9091f3c7ad344fa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:59.417742 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-8b5220c3-a835-456e-a370-40e39d5ce3db tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] 10.222.0.23 "GET /compute/v2.1/servers/d44a95a1-4af4-48df-9d5b-5b0d927418f1" status: 200 len: 1267 microversion: 2.1 time: 0.216003 Jul 12 13:36:59.418335 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 410/833] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:36:59 2022] GET /compute/v2.1/servers/d44a95a1-4af4-48df-9d5b-5b0d927418f1 => generated 1267 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:36:59.540066 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-8db653cb-f70e-48b1-913b-76fc7e19967a tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:59.548112 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-8db653cb-f70e-48b1-913b-76fc7e19967a tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:59.550258 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-8db653cb-f70e-48b1-913b-76fc7e19967a tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:36:59.551476 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-8db653cb-f70e-48b1-913b-76fc7e19967a tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/90cd5e2a-127d-4329-93ff-1a8dc66cf049" status: 200 len: 1729 microversion: 2.20 time: 0.164647 Jul 12 13:36:59.552038 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 424/834] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:36:59 2022] GET /compute/v2.1/servers/90cd5e2a-127d-4329-93ff-1a8dc66cf049 => generated 1729 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:36:59.839360 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-d0323a68-221e-4074-ab34-7466e5be15a1 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:36:59.839847 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-d0323a68-221e-4074-ab34-7466e5be15a1 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] [instance: a4c23b11-fc12-4dd8-8a9c-9019f9e101c9] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:36:59.846342 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-d0323a68-221e-4074-ab34-7466e5be15a1 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:59.846854 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-d0323a68-221e-4074-ab34-7466e5be15a1 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:59.847676 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-d0323a68-221e-4074-ab34-7466e5be15a1 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:59.848190 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-d0323a68-221e-4074-ab34-7466e5be15a1 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:59.878007 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-d0323a68-221e-4074-ab34-7466e5be15a1 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] 10.222.0.23 "GET /compute/v2.1/servers/a4c23b11-fc12-4dd8-8a9c-9019f9e101c9/os-volume_attachments/11bee16e-0712-42f9-ace7-951331c2175a" status: 200 len: 194 microversion: 2.1 time: 0.042494 Jul 12 13:36:59.878778 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 411/835] 10.222.0.23 () {58 vars in 1412 bytes} [Tue Jul 12 13:36:59 2022] GET /compute/v2.1/servers/a4c23b11-fc12-4dd8-8a9c-9019f9e101c9/os-volume_attachments/11bee16e-0712-42f9-ace7-951331c2175a => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 13:36:59.888544 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-d71449fe-5d28-4e90-9ee3-b0317500e414 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:36:59.889072 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-d71449fe-5d28-4e90-9ee3-b0317500e414 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] [instance: a4c23b11-fc12-4dd8-8a9c-9019f9e101c9] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:36:59.895135 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-d71449fe-5d28-4e90-9ee3-b0317500e414 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:59.895583 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-d71449fe-5d28-4e90-9ee3-b0317500e414 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:59.896343 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-d71449fe-5d28-4e90-9ee3-b0317500e414 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:36:59.896779 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-d71449fe-5d28-4e90-9ee3-b0317500e414 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:36:59.987438 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.objects.instance [None req-d71449fe-5d28-4e90-9ee3-b0317500e414 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lazy-loading 'services' on Instance uuid a4c23b11-fc12-4dd8-8a9c-9019f9e101c9 {{(pid=117988) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 13:37:00.054902 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [req-d24ccf2b-a71c-4727-8119-317f7cc60bcf req-907df62a-eca6-44fa-a24f-0d19b59170fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d44a95a1-4af4-48df-9d5b-5b0d927418f1", "name": "network-vif-plugged", "status": "completed", "tag": "cda66e5a-baa7-4459-95c8-2a183c1b2f13"}]} {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:37:00.065309 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [req-d24ccf2b-a71c-4727-8119-317f7cc60bcf req-907df62a-eca6-44fa-a24f-0d19b59170fb service nova] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:37:00.066061 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [req-d24ccf2b-a71c-4727-8119-317f7cc60bcf req-907df62a-eca6-44fa-a24f-0d19b59170fb service nova] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:37:00.071144 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-d71449fe-5d28-4e90-9ee3-b0317500e414 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] 10.222.0.23 "DELETE /compute/v2.1/servers/a4c23b11-fc12-4dd8-8a9c-9019f9e101c9/os-volume_attachments/11bee16e-0712-42f9-ace7-951331c2175a" status: 202 len: 0 microversion: 2.1 time: 0.186401 Jul 12 13:37:00.072017 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 425/836] 10.222.0.23 () {58 vars in 1415 bytes} [Tue Jul 12 13:36:59 2022] DELETE /compute/v2.1/servers/a4c23b11-fc12-4dd8-8a9c-9019f9e101c9/os-volume_attachments/11bee16e-0712-42f9-ace7-951331c2175a => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 13:37:00.078461 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.compute.server_external_events [req-d24ccf2b-a71c-4727-8119-317f7cc60bcf req-907df62a-eca6-44fa-a24f-0d19b59170fb service nova] Creating event network-vif-plugged:cda66e5a-baa7-4459-95c8-2a183c1b2f13 for instance d44a95a1-4af4-48df-9d5b-5b0d927418f1 on hv-cinder-82002 Jul 12 13:37:00.084822 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [req-d24ccf2b-a71c-4727-8119-317f7cc60bcf req-907df62a-eca6-44fa-a24f-0d19b59170fb service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034855 Jul 12 13:37:00.085491 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 412/837] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 12 13:37:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 13:37:00.406296 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-443ffc3d-092b-4c98-a061-c73db86a4a1b tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:37:00.407386 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-443ffc3d-092b-4c98-a061-c73db86a4a1b tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] [instance: f92d789f-e61f-428b-9898-4debd69b8c71] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:37:00.417052 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-443ffc3d-092b-4c98-a061-c73db86a4a1b tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:37:00.417654 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-443ffc3d-092b-4c98-a061-c73db86a4a1b tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:37:00.418443 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-443ffc3d-092b-4c98-a061-c73db86a4a1b tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:37:00.419102 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-443ffc3d-092b-4c98-a061-c73db86a4a1b tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:37:00.439095 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-579ade43-03c0-4de6-b2ce-2bd381f64057 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:37:00.440421 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-579ade43-03c0-4de6-b2ce-2bd381f64057 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] [instance: d44a95a1-4af4-48df-9d5b-5b0d927418f1] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:37:00.461234 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-579ade43-03c0-4de6-b2ce-2bd381f64057 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:37:00.461719 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-579ade43-03c0-4de6-b2ce-2bd381f64057 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:37:00.462505 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-579ade43-03c0-4de6-b2ce-2bd381f64057 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:37:00.462944 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-579ade43-03c0-4de6-b2ce-2bd381f64057 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:37:00.749604 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-443ffc3d-092b-4c98-a061-c73db86a4a1b tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a8c2a9145ac48fd8ddf2f5f76cc6425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d960c42bd04476bd6f9b83ae7a2fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:37:00.758056 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-443ffc3d-092b-4c98-a061-c73db86a4a1b tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] 10.222.0.23 "GET /compute/v2.1/servers/f92d789f-e61f-428b-9898-4debd69b8c71" status: 200 len: 1503 microversion: 2.1 time: 0.356973 Jul 12 13:37:00.758651 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 426/838] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:37:00 2022] GET /compute/v2.1/servers/f92d789f-e61f-428b-9898-4debd69b8c71 => generated 1503 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:37:00.764931 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-0da99d52-b74e-4903-8a64-3af46a1bde80 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:37:00.765590 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-0da99d52-b74e-4903-8a64-3af46a1bde80 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 90cd5e2a-127d-4329-93ff-1a8dc66cf049] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:37:00.772932 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-0da99d52-b74e-4903-8a64-3af46a1bde80 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:37:00.773835 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-0da99d52-b74e-4903-8a64-3af46a1bde80 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:37:00.774028 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-579ade43-03c0-4de6-b2ce-2bd381f64057 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa0b8a0b7ff4eb0b13fb985dc0d710a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3897c86b8c847ea9091f3c7ad344fa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:37:00.774204 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-0da99d52-b74e-4903-8a64-3af46a1bde80 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:37:00.774628 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-0da99d52-b74e-4903-8a64-3af46a1bde80 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:37:00.781530 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-579ade43-03c0-4de6-b2ce-2bd381f64057 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] 10.222.0.23 "GET /compute/v2.1/servers/d44a95a1-4af4-48df-9d5b-5b0d927418f1" status: 200 len: 1267 microversion: 2.1 time: 0.350615 Jul 12 13:37:00.791363 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 413/839] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:37:00 2022] GET /compute/v2.1/servers/d44a95a1-4af4-48df-9d5b-5b0d927418f1 => generated 1267 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:37:00.993627 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-0da99d52-b74e-4903-8a64-3af46a1bde80 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:37:00.996979 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG dbcounter [-] [117988] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117988) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:37:01.023345 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-0da99d52-b74e-4903-8a64-3af46a1bde80 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:37:01.024854 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-0da99d52-b74e-4903-8a64-3af46a1bde80 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:37:01.026736 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-0da99d52-b74e-4903-8a64-3af46a1bde80 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/90cd5e2a-127d-4329-93ff-1a8dc66cf049" status: 200 len: 1729 microversion: 2.20 time: 0.266657 Jul 12 13:37:01.027751 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 427/840] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:37:00 2022] GET /compute/v2.1/servers/90cd5e2a-127d-4329-93ff-1a8dc66cf049 => generated 1729 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:37:01.150943 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [req-a349cfc2-e61c-49d5-8b08-8820b6371995 req-19a69341-1bcb-4e96-9ea2-f69ecf3988aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f92d789f-e61f-428b-9898-4debd69b8c71", "name": "network-vif-deleted", "tag": "1e01ea85-e6d2-4fcd-a56a-1653bb077eff"}]} {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:37:01.161889 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [req-a349cfc2-e61c-49d5-8b08-8820b6371995 req-19a69341-1bcb-4e96-9ea2-f69ecf3988aa service nova] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:37:01.161889 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [req-a349cfc2-e61c-49d5-8b08-8820b6371995 req-19a69341-1bcb-4e96-9ea2-f69ecf3988aa service nova] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:37:01.175368 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.compute.server_external_events [req-a349cfc2-e61c-49d5-8b08-8820b6371995 req-19a69341-1bcb-4e96-9ea2-f69ecf3988aa service nova] Creating event network-vif-deleted:1e01ea85-e6d2-4fcd-a56a-1653bb077eff for instance f92d789f-e61f-428b-9898-4debd69b8c71 on hv-cinder-82002 Jul 12 13:37:01.190886 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [req-a349cfc2-e61c-49d5-8b08-8820b6371995 req-19a69341-1bcb-4e96-9ea2-f69ecf3988aa service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033957 Jul 12 13:37:01.191570 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 414/841] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 12 13:37:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:37:01.775583 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-39d6af53-e1a9-483c-baad-42455f23e7c1 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:37:01.776210 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-39d6af53-e1a9-483c-baad-42455f23e7c1 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] [instance: f92d789f-e61f-428b-9898-4debd69b8c71] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:37:01.783484 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-39d6af53-e1a9-483c-baad-42455f23e7c1 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:37:01.784025 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-39d6af53-e1a9-483c-baad-42455f23e7c1 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:37:01.784739 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-39d6af53-e1a9-483c-baad-42455f23e7c1 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:37:01.785177 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-39d6af53-e1a9-483c-baad-42455f23e7c1 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:37:01.801534 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-ffa0aeff-8a3c-4eb5-8785-09058f0e7843 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:37:01.802268 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-ffa0aeff-8a3c-4eb5-8785-09058f0e7843 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] [instance: d44a95a1-4af4-48df-9d5b-5b0d927418f1] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:37:01.809684 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-ffa0aeff-8a3c-4eb5-8785-09058f0e7843 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:37:01.810127 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-ffa0aeff-8a3c-4eb5-8785-09058f0e7843 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:37:01.810896 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-ffa0aeff-8a3c-4eb5-8785-09058f0e7843 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:37:01.811326 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-ffa0aeff-8a3c-4eb5-8785-09058f0e7843 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:37:01.860185 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-39d6af53-e1a9-483c-baad-42455f23e7c1 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a8c2a9145ac48fd8ddf2f5f76cc6425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d960c42bd04476bd6f9b83ae7a2fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:37:01.867891 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-39d6af53-e1a9-483c-baad-42455f23e7c1 tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] 10.222.0.23 "GET /compute/v2.1/servers/f92d789f-e61f-428b-9898-4debd69b8c71" status: 200 len: 1299 microversion: 2.1 time: 0.096149 Jul 12 13:37:01.868647 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 428/842] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:37:01 2022] GET /compute/v2.1/servers/f92d789f-e61f-428b-9898-4debd69b8c71 => generated 1299 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:37:01.955935 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-ffa0aeff-8a3c-4eb5-8785-09058f0e7843 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa0b8a0b7ff4eb0b13fb985dc0d710a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3897c86b8c847ea9091f3c7ad344fa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:37:01.963757 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-ffa0aeff-8a3c-4eb5-8785-09058f0e7843 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] 10.222.0.23 "GET /compute/v2.1/servers/d44a95a1-4af4-48df-9d5b-5b0d927418f1" status: 200 len: 1267 microversion: 2.1 time: 0.168557 Jul 12 13:37:01.964340 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 415/843] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:37:01 2022] GET /compute/v2.1/servers/d44a95a1-4af4-48df-9d5b-5b0d927418f1 => generated 1267 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:37:02.048050 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-fa31cb56-e56a-4944-88d5-2cb5e82ddbf7 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:37:02.049348 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-fa31cb56-e56a-4944-88d5-2cb5e82ddbf7 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] [instance: 90cd5e2a-127d-4329-93ff-1a8dc66cf049] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:37:02.055812 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-fa31cb56-e56a-4944-88d5-2cb5e82ddbf7 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:37:02.056317 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-fa31cb56-e56a-4944-88d5-2cb5e82ddbf7 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:37:02.057095 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-fa31cb56-e56a-4944-88d5-2cb5e82ddbf7 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:37:02.057574 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-fa31cb56-e56a-4944-88d5-2cb5e82ddbf7 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:37:02.188106 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-fa31cb56-e56a-4944-88d5-2cb5e82ddbf7 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:37:02.198305 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-fa31cb56-e56a-4944-88d5-2cb5e82ddbf7 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:37:02.200836 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-fa31cb56-e56a-4944-88d5-2cb5e82ddbf7 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8de4128718d4837af77d427973d30be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2414687e6d4a449e3aeec65921b3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:37:02.200836 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-fa31cb56-e56a-4944-88d5-2cb5e82ddbf7 tempest-AttachVolumeShelveTestJSON-1205023784 tempest-AttachVolumeShelveTestJSON-1205023784-project] 10.222.0.23 "GET /compute/v2.1/servers/90cd5e2a-127d-4329-93ff-1a8dc66cf049" status: 200 len: 1716 microversion: 2.20 time: 0.156893 Jul 12 13:37:02.214103 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 429/844] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jul 12 13:37:02 2022] GET /compute/v2.1/servers/90cd5e2a-127d-4329-93ff-1a8dc66cf049 => generated 1716 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:37:02.885527 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-77608faa-9f68-4059-80ed-ed2d466e4c4d tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:37:02.886153 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-77608faa-9f68-4059-80ed-ed2d466e4c4d tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] [instance: f92d789f-e61f-428b-9898-4debd69b8c71] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:37:02.892782 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-77608faa-9f68-4059-80ed-ed2d466e4c4d tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:37:02.893740 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-77608faa-9f68-4059-80ed-ed2d466e4c4d tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:37:02.894480 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-77608faa-9f68-4059-80ed-ed2d466e4c4d tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:37:02.894922 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-77608faa-9f68-4059-80ed-ed2d466e4c4d tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:37:02.929365 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-77608faa-9f68-4059-80ed-ed2d466e4c4d tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:37:02.929845 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-77608faa-9f68-4059-80ed-ed2d466e4c4d tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:37:02.930298 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.objects.instance [None req-77608faa-9f68-4059-80ed-ed2d466e4c4d tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lazy-loading 'fault' on Instance uuid f92d789f-e61f-428b-9898-4debd69b8c71 {{(pid=117987) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 13:37:02.971699 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-77608faa-9f68-4059-80ed-ed2d466e4c4d tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a8c2a9145ac48fd8ddf2f5f76cc6425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d960c42bd04476bd6f9b83ae7a2fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:37:02.979546 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-77608faa-9f68-4059-80ed-ed2d466e4c4d tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] 10.222.0.23 "GET /compute/v2.1/servers/f92d789f-e61f-428b-9898-4debd69b8c71" status: 200 len: 1304 microversion: 2.1 time: 0.098493 Jul 12 13:37:02.980125 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 416/845] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:37:02 2022] GET /compute/v2.1/servers/f92d789f-e61f-428b-9898-4debd69b8c71 => generated 1304 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:37:02.981009 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-05d5378c-c29b-4d57-9a16-8a41b585f948 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:37:02.981653 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-05d5378c-c29b-4d57-9a16-8a41b585f948 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] [instance: d44a95a1-4af4-48df-9d5b-5b0d927418f1] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:37:02.989221 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-05d5378c-c29b-4d57-9a16-8a41b585f948 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:37:02.989800 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-05d5378c-c29b-4d57-9a16-8a41b585f948 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:37:02.990633 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-05d5378c-c29b-4d57-9a16-8a41b585f948 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:37:02.991064 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-05d5378c-c29b-4d57-9a16-8a41b585f948 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:37:03.132172 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-05d5378c-c29b-4d57-9a16-8a41b585f948 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa0b8a0b7ff4eb0b13fb985dc0d710a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3897c86b8c847ea9091f3c7ad344fa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:37:03.139895 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-05d5378c-c29b-4d57-9a16-8a41b585f948 tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] 10.222.0.23 "GET /compute/v2.1/servers/d44a95a1-4af4-48df-9d5b-5b0d927418f1" status: 200 len: 1453 microversion: 2.1 time: 0.162615 Jul 12 13:37:03.140476 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 430/846] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:37:02 2022] GET /compute/v2.1/servers/d44a95a1-4af4-48df-9d5b-5b0d927418f1 => generated 1453 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:37:03.155868 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-6421242e-705a-43ac-9251-d1ef89246cab tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:37:03.156383 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-6421242e-705a-43ac-9251-d1ef89246cab tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] [instance: d44a95a1-4af4-48df-9d5b-5b0d927418f1] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:37:03.163291 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-6421242e-705a-43ac-9251-d1ef89246cab tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:37:03.163794 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-6421242e-705a-43ac-9251-d1ef89246cab tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:37:03.164577 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-6421242e-705a-43ac-9251-d1ef89246cab tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:37:03.165013 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-6421242e-705a-43ac-9251-d1ef89246cab tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:37:03.336309 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-6421242e-705a-43ac-9251-d1ef89246cab tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa0b8a0b7ff4eb0b13fb985dc0d710a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3897c86b8c847ea9091f3c7ad344fa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:37:03.344779 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-6421242e-705a-43ac-9251-d1ef89246cab tempest-TestVolumeBootPattern-1901128386 tempest-TestVolumeBootPattern-1901128386-project] 10.222.0.23 "GET /compute/v2.1/servers/d44a95a1-4af4-48df-9d5b-5b0d927418f1" status: 200 len: 1453 microversion: 2.1 time: 0.192743 Jul 12 13:37:03.346789 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 417/847] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:37:03 2022] GET /compute/v2.1/servers/d44a95a1-4af4-48df-9d5b-5b0d927418f1 => generated 1453 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:37:03.398337 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-f045739c-0563-4dbd-9449-7bceb31c6c61 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:37:03.399332 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-f045739c-0563-4dbd-9449-7bceb31c6c61 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] [instance: a4c23b11-fc12-4dd8-8a9c-9019f9e101c9] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:37:03.405988 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-f045739c-0563-4dbd-9449-7bceb31c6c61 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:37:03.406386 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-f045739c-0563-4dbd-9449-7bceb31c6c61 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:37:03.407159 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-f045739c-0563-4dbd-9449-7bceb31c6c61 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:37:03.407595 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-f045739c-0563-4dbd-9449-7bceb31c6c61 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:37:03.439584 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-f045739c-0563-4dbd-9449-7bceb31c6c61 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] 10.222.0.23 "GET /compute/v2.1/servers/a4c23b11-fc12-4dd8-8a9c-9019f9e101c9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045268 Jul 12 13:37:03.440214 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 431/848] 10.222.0.23 () {58 vars in 1301 bytes} [Tue Jul 12 13:37:03 2022] GET /compute/v2.1/servers/a4c23b11-fc12-4dd8-8a9c-9019f9e101c9/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 12 13:37:03.559739 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-1c1e524a-192c-4993-8cf4-5eeff611bbf8 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:37:03.560652 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-1c1e524a-192c-4993-8cf4-5eeff611bbf8 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] [instance: a4c23b11-fc12-4dd8-8a9c-9019f9e101c9] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:37:03.567642 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-1c1e524a-192c-4993-8cf4-5eeff611bbf8 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:37:03.568337 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-1c1e524a-192c-4993-8cf4-5eeff611bbf8 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:37:03.569110 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-1c1e524a-192c-4993-8cf4-5eeff611bbf8 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:37:03.569570 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-1c1e524a-192c-4993-8cf4-5eeff611bbf8 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:37:03.600301 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-1c1e524a-192c-4993-8cf4-5eeff611bbf8 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] 10.222.0.23 "GET /compute/v2.1/servers/a4c23b11-fc12-4dd8-8a9c-9019f9e101c9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044391 Jul 12 13:37:03.600893 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 418/849] 10.222.0.23 () {58 vars in 1301 bytes} [Tue Jul 12 13:37:03 2022] GET /compute/v2.1/servers/a4c23b11-fc12-4dd8-8a9c-9019f9e101c9/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 12 13:37:03.667350 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-8f3ef9aa-d402-4eb6-8847-c3f1a9a6314c tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:37:03.667853 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-8f3ef9aa-d402-4eb6-8847-c3f1a9a6314c tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] [instance: a4c23b11-fc12-4dd8-8a9c-9019f9e101c9] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:37:03.674638 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-8f3ef9aa-d402-4eb6-8847-c3f1a9a6314c tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:37:03.675101 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-8f3ef9aa-d402-4eb6-8847-c3f1a9a6314c tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:37:03.675880 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-8f3ef9aa-d402-4eb6-8847-c3f1a9a6314c tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:37:03.676357 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-8f3ef9aa-d402-4eb6-8847-c3f1a9a6314c tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:37:03.702775 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-8f3ef9aa-d402-4eb6-8847-c3f1a9a6314c tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] [instance: a4c23b11-fc12-4dd8-8a9c-9019f9e101c9] Going to try to terminate instance {{(pid=117988) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 13:37:03.793082 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-8f3ef9aa-d402-4eb6-8847-c3f1a9a6314c tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] 10.222.0.23 "DELETE /compute/v2.1/servers/a4c23b11-fc12-4dd8-8a9c-9019f9e101c9" status: 204 len: 0 microversion: 2.1 time: 0.129077 Jul 12 13:37:03.794027 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 432/850] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 12 13:37:03 2022] DELETE /compute/v2.1/servers/a4c23b11-fc12-4dd8-8a9c-9019f9e101c9 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 13:37:03.803022 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-50f9065f-4982-4b2d-bebc-afa78ab03369 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:37:03.803999 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-50f9065f-4982-4b2d-bebc-afa78ab03369 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] [instance: a4c23b11-fc12-4dd8-8a9c-9019f9e101c9] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:37:03.810421 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-50f9065f-4982-4b2d-bebc-afa78ab03369 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:37:03.811274 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-50f9065f-4982-4b2d-bebc-afa78ab03369 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:37:03.812273 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-50f9065f-4982-4b2d-bebc-afa78ab03369 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:37:03.812671 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-50f9065f-4982-4b2d-bebc-afa78ab03369 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:37:03.960844 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-50f9065f-4982-4b2d-bebc-afa78ab03369 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b710bbdf0c4d58b4f3ee7ef7410c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8fca4ab6ed466a864c5551fea5f7ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:37:03.968777 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-50f9065f-4982-4b2d-bebc-afa78ab03369 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] 10.222.0.23 "GET /compute/v2.1/servers/a4c23b11-fc12-4dd8-8a9c-9019f9e101c9" status: 200 len: 1673 microversion: 2.1 time: 0.170626 Jul 12 13:37:03.969364 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 419/851] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:37:03 2022] GET /compute/v2.1/servers/a4c23b11-fc12-4dd8-8a9c-9019f9e101c9 => generated 1673 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:37:03.998023 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-a88d5de0-d5bd-460a-8ecd-6badc65ed43b tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:37:03.999380 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-a88d5de0-d5bd-460a-8ecd-6badc65ed43b tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] [instance: f92d789f-e61f-428b-9898-4debd69b8c71] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:37:04.006120 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-a88d5de0-d5bd-460a-8ecd-6badc65ed43b tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:37:04.006574 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-a88d5de0-d5bd-460a-8ecd-6badc65ed43b tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:37:04.007358 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-a88d5de0-d5bd-460a-8ecd-6badc65ed43b tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:37:04.007795 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-a88d5de0-d5bd-460a-8ecd-6badc65ed43b tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:37:04.174944 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.wsgi [None req-a88d5de0-d5bd-460a-8ecd-6badc65ed43b tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] HTTP exception thrown: Instance f92d789f-e61f-428b-9898-4debd69b8c71 could not be found. Jul 12 13:37:04.176491 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-a88d5de0-d5bd-460a-8ecd-6badc65ed43b tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Request method failure captured: Jul 12 13:37:04.176491 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: request: GET /compute/v2.1/servers/f92d789f-e61f-428b-9898-4debd69b8c71 HTTP/1.1 Jul 12 13:37:04.176491 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: Accept: application/json Jul 12 13:37:04.176491 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: Accept-Encoding: identity Jul 12 13:37:04.176491 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: Connection: close Jul 12 13:37:04.176491 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: Content-Length: 0 Jul 12 13:37:04.176491 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: Content-Type: application/json Jul 12 13:37:04.176491 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: Host: 10.222.0.23 Jul 12 13:37:04.176491 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: Openstack-System-Scope: None Jul 12 13:37:04.176491 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: User-Agent: python-urllib3/1.26.9 Jul 12 13:37:04.176491 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Auth-Token: gAAAAABizXjI0qt7cqYMW5NO_6g9VMp_64lCUUs9MeyDHXStIgzeW1Iy7k2clL9uCKK2FaXzt2lIm7Pla2V83mE6NXNwLAE9q62PJJRlL3ufUHmBIxAuXjLWCHoNjF9Yeypuhr3298ySrx2VqSl9UExLr8U_NqQwEYTpeZjDwWeQNYa1orYKqAo Jul 12 13:37:04.176491 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Domain-Id: None Jul 12 13:37:04.176491 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Domain-Name: None Jul 12 13:37:04.176491 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Identity-Status: Confirmed Jul 12 13:37:04.176491 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Is-Admin-Project: True Jul 12 13:37:04.176491 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Project-Domain-Id: default Jul 12 13:37:04.176491 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Project-Domain-Name: Default Jul 12 13:37:04.176491 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Project-Id: a8d960c42bd04476bd6f9b83ae7a2fb6 Jul 12 13:37:04.176491 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Project-Name: tempest-VolumesActionsTest-1559890554 Jul 12 13:37:04.176491 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Role: reader,member Jul 12 13:37:04.176491 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Roles: reader,member Jul 12 13:37:04.177999 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a8d960c42bd04476bd6f9b83ae7a2fb6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a8d960c42bd04476bd6f9b83ae7a2fb6", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a8d960c42bd04476bd6f9b83ae7a2fb6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a8d960c42bd04476bd6f9b83ae7a2fb6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] Jul 12 13:37:04.177999 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Tenant: tempest-VolumesActionsTest-1559890554 Jul 12 13:37:04.177999 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Tenant-Id: a8d960c42bd04476bd6f9b83ae7a2fb6 Jul 12 13:37:04.177999 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Tenant-Name: tempest-VolumesActionsTest-1559890554 Jul 12 13:37:04.177999 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-User: tempest-VolumesActionsTest-1559890554-project Jul 12 13:37:04.177999 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-User-Domain-Id: default Jul 12 13:37:04.177999 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-User-Domain-Name: Default Jul 12 13:37:04.177999 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-User-Id: 9a8c2a9145ac48fd8ddf2f5f76cc6425 Jul 12 13:37:04.177999 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-User-Name: tempest-VolumesActionsTest-1559890554-project Jul 12 13:37:04.177999 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: method: > Jul 12 13:37:04.177999 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: exception: Instance f92d789f-e61f-428b-9898-4debd69b8c71 could not be found. Jul 12 13:37:04.177999 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: action_args: {'id': 'f92d789f-e61f-428b-9898-4debd69b8c71'} Jul 12 13:37:04.178803 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 13:37:04.178803 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:37:04.178803 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 13:37:04.178803 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 13:37:04.178803 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 13:37:04.178803 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 13:37:04.178803 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 13:37:04.178803 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 13:37:04.178803 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 13:37:04.178803 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 13:37:04.178803 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f92d789f-e61f-428b-9898-4debd69b8c71 could not be found. Jul 12 13:37:04.178803 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi Jul 12 13:37:04.178803 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:37:04.178803 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi Jul 12 13:37:04.178803 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:37:04.178803 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:37:04.178803 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:37:04.178803 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 13:37:04.178803 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 13:37:04.178803 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 13:37:04.180047 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:37:04.180047 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 13:37:04.180047 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 13:37:04.180047 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 13:37:04.180047 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 13:37:04.180047 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 13:37:04.180047 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 13:37:04.180047 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f92d789f-e61f-428b-9898-4debd69b8c71 could not be found. Jul 12 13:37:04.180047 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi Jul 12 13:37:04.180047 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:37:04.180047 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi Jul 12 13:37:04.180047 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:37:04.180047 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:37:04.180047 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:37:04.180047 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 13:37:04.180047 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 13:37:04.180047 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f92d789f-e61f-428b-9898-4debd69b8c71 could not be found. Jul 12 13:37:04.180047 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi Jul 12 13:37:04.181151 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-a88d5de0-d5bd-460a-8ecd-6badc65ed43b tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] Returning 404 to user: Instance f92d789f-e61f-428b-9898-4debd69b8c71 could not be found. {{(pid=117988) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 13:37:04.181151 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-a88d5de0-d5bd-460a-8ecd-6badc65ed43b tempest-VolumesActionsTest-1559890554 tempest-VolumesActionsTest-1559890554-project] 10.222.0.23 "GET /compute/v2.1/servers/f92d789f-e61f-428b-9898-4debd69b8c71" status: 404 len: 111 microversion: 2.1 time: 0.184325 Jul 12 13:37:04.181151 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 433/852] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:37:03 2022] GET /compute/v2.1/servers/f92d789f-e61f-428b-9898-4debd69b8c71 => generated 111 bytes in 186 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 13:37:04.987951 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-243c5cf0-cf94-4362-a41c-31a7df5750ab tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:37:04.988670 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-243c5cf0-cf94-4362-a41c-31a7df5750ab tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] [instance: a4c23b11-fc12-4dd8-8a9c-9019f9e101c9] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:37:04.995889 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-243c5cf0-cf94-4362-a41c-31a7df5750ab tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:37:04.996329 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-243c5cf0-cf94-4362-a41c-31a7df5750ab tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:37:04.997137 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-243c5cf0-cf94-4362-a41c-31a7df5750ab tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:37:04.997764 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-243c5cf0-cf94-4362-a41c-31a7df5750ab tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:37:05.140175 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-243c5cf0-cf94-4362-a41c-31a7df5750ab tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b710bbdf0c4d58b4f3ee7ef7410c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8fca4ab6ed466a864c5551fea5f7ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:37:05.148961 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-243c5cf0-cf94-4362-a41c-31a7df5750ab tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] 10.222.0.23 "GET /compute/v2.1/servers/a4c23b11-fc12-4dd8-8a9c-9019f9e101c9" status: 200 len: 1673 microversion: 2.1 time: 0.165979 Jul 12 13:37:05.149738 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 420/853] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:37:04 2022] GET /compute/v2.1/servers/a4c23b11-fc12-4dd8-8a9c-9019f9e101c9 => generated 1673 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:37:05.410663 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [req-302165cd-1d1d-4569-8d9f-f1bc55097f3d req-d5bf1041-a05c-414b-8bdd-1c7f72a2aaa7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d44a95a1-4af4-48df-9d5b-5b0d927418f1", "tag": "cda66e5a-baa7-4459-95c8-2a183c1b2f13"}]} {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:37:05.420030 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [req-302165cd-1d1d-4569-8d9f-f1bc55097f3d req-d5bf1041-a05c-414b-8bdd-1c7f72a2aaa7 service nova] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:37:05.420475 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [req-302165cd-1d1d-4569-8d9f-f1bc55097f3d req-d5bf1041-a05c-414b-8bdd-1c7f72a2aaa7 service nova] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:37:05.431185 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.compute.server_external_events [req-302165cd-1d1d-4569-8d9f-f1bc55097f3d req-d5bf1041-a05c-414b-8bdd-1c7f72a2aaa7 service nova] Creating event network-changed:cda66e5a-baa7-4459-95c8-2a183c1b2f13 for instance d44a95a1-4af4-48df-9d5b-5b0d927418f1 on hv-cinder-82002 Jul 12 13:37:05.436200 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [req-302165cd-1d1d-4569-8d9f-f1bc55097f3d req-d5bf1041-a05c-414b-8bdd-1c7f72a2aaa7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029219 Jul 12 13:37:05.436809 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 434/854] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 12 13:37:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:37:06.167001 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-9e63b147-04d7-4575-ac64-968767b8440c tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:37:06.167626 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-9e63b147-04d7-4575-ac64-968767b8440c tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] [instance: a4c23b11-fc12-4dd8-8a9c-9019f9e101c9] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:37:06.174862 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-9e63b147-04d7-4575-ac64-968767b8440c tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:37:06.175308 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-9e63b147-04d7-4575-ac64-968767b8440c tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:37:06.176089 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-9e63b147-04d7-4575-ac64-968767b8440c tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:37:06.176522 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-9e63b147-04d7-4575-ac64-968767b8440c tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:37:06.324527 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-9e63b147-04d7-4575-ac64-968767b8440c tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b710bbdf0c4d58b4f3ee7ef7410c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8fca4ab6ed466a864c5551fea5f7ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:37:06.333078 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-9e63b147-04d7-4575-ac64-968767b8440c tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] 10.222.0.23 "GET /compute/v2.1/servers/a4c23b11-fc12-4dd8-8a9c-9019f9e101c9" status: 200 len: 1673 microversion: 2.1 time: 0.169908 Jul 12 13:37:06.333722 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 421/855] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:37:06 2022] GET /compute/v2.1/servers/a4c23b11-fc12-4dd8-8a9c-9019f9e101c9 => generated 1673 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:37:07.351361 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-3520bdf1-c4dc-4cf5-8125-72566dac411a tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:37:07.352054 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-3520bdf1-c4dc-4cf5-8125-72566dac411a tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] [instance: a4c23b11-fc12-4dd8-8a9c-9019f9e101c9] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:37:07.358344 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-3520bdf1-c4dc-4cf5-8125-72566dac411a tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:37:07.358794 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-3520bdf1-c4dc-4cf5-8125-72566dac411a tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:37:07.359564 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-3520bdf1-c4dc-4cf5-8125-72566dac411a tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:37:07.359999 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-3520bdf1-c4dc-4cf5-8125-72566dac411a tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:37:07.499463 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-3520bdf1-c4dc-4cf5-8125-72566dac411a tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b710bbdf0c4d58b4f3ee7ef7410c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8fca4ab6ed466a864c5551fea5f7ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:37:07.508000 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-3520bdf1-c4dc-4cf5-8125-72566dac411a tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] 10.222.0.23 "GET /compute/v2.1/servers/a4c23b11-fc12-4dd8-8a9c-9019f9e101c9" status: 200 len: 1673 microversion: 2.1 time: 0.161216 Jul 12 13:37:07.508493 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 435/856] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:37:07 2022] GET /compute/v2.1/servers/a4c23b11-fc12-4dd8-8a9c-9019f9e101c9 => generated 1673 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:37:08.526659 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-08d361d9-b0fa-4ec5-a61f-d7baf2cda81a tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:37:08.527269 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-08d361d9-b0fa-4ec5-a61f-d7baf2cda81a tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] [instance: a4c23b11-fc12-4dd8-8a9c-9019f9e101c9] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:37:08.534399 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-08d361d9-b0fa-4ec5-a61f-d7baf2cda81a tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:37:08.535200 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-08d361d9-b0fa-4ec5-a61f-d7baf2cda81a tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:37:08.536593 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-08d361d9-b0fa-4ec5-a61f-d7baf2cda81a tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:37:08.537065 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-08d361d9-b0fa-4ec5-a61f-d7baf2cda81a tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:37:08.542213 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG dbcounter [-] [117987] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117987) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:37:08.674840 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.policy [None req-08d361d9-b0fa-4ec5-a61f-d7baf2cda81a tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b710bbdf0c4d58b4f3ee7ef7410c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8fca4ab6ed466a864c5551fea5f7ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117987) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:37:08.682973 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-08d361d9-b0fa-4ec5-a61f-d7baf2cda81a tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] 10.222.0.23 "GET /compute/v2.1/servers/a4c23b11-fc12-4dd8-8a9c-9019f9e101c9" status: 200 len: 1673 microversion: 2.1 time: 0.160208 Jul 12 13:37:08.683559 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 422/857] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:37:08 2022] GET /compute/v2.1/servers/a4c23b11-fc12-4dd8-8a9c-9019f9e101c9 => generated 1673 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:37:09.701289 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-d39d7151-88b4-4a05-b114-d1a9b22efec8 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:37:09.701932 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-d39d7151-88b4-4a05-b114-d1a9b22efec8 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] [instance: a4c23b11-fc12-4dd8-8a9c-9019f9e101c9] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:37:09.709932 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-d39d7151-88b4-4a05-b114-d1a9b22efec8 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:37:09.710374 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-d39d7151-88b4-4a05-b114-d1a9b22efec8 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:37:09.711148 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-d39d7151-88b4-4a05-b114-d1a9b22efec8 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:37:09.711580 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-d39d7151-88b4-4a05-b114-d1a9b22efec8 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:37:09.852787 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-d39d7151-88b4-4a05-b114-d1a9b22efec8 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b710bbdf0c4d58b4f3ee7ef7410c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8fca4ab6ed466a864c5551fea5f7ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:37:09.860245 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-d39d7151-88b4-4a05-b114-d1a9b22efec8 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] 10.222.0.23 "GET /compute/v2.1/servers/a4c23b11-fc12-4dd8-8a9c-9019f9e101c9" status: 200 len: 1673 microversion: 2.1 time: 0.162858 Jul 12 13:37:09.860834 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 436/858] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:37:09 2022] GET /compute/v2.1/servers/a4c23b11-fc12-4dd8-8a9c-9019f9e101c9 => generated 1673 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:37:10.871411 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [req-c4fd36b1-2fde-4f4a-a727-283b73a6837a req-da468c66-268d-4800-a1de-d980b68d884e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4c23b11-fc12-4dd8-8a9c-9019f9e101c9", "name": "network-vif-deleted", "tag": "db6b5192-4809-4713-81d9-1ab933f58c63"}]} {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:37:10.877542 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-e73665c3-bf7e-4ed6-aefc-3a909aa72d56 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:37:10.878328 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-e73665c3-bf7e-4ed6-aefc-3a909aa72d56 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] [instance: a4c23b11-fc12-4dd8-8a9c-9019f9e101c9] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:37:10.896208 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-e73665c3-bf7e-4ed6-aefc-3a909aa72d56 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:37:10.898748 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [req-c4fd36b1-2fde-4f4a-a727-283b73a6837a req-da468c66-268d-4800-a1de-d980b68d884e service nova] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:37:10.899485 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-e73665c3-bf7e-4ed6-aefc-3a909aa72d56 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:37:10.900463 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-e73665c3-bf7e-4ed6-aefc-3a909aa72d56 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:37:10.901090 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [req-c4fd36b1-2fde-4f4a-a727-283b73a6837a req-da468c66-268d-4800-a1de-d980b68d884e service nova] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:37:10.904640 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-e73665c3-bf7e-4ed6-aefc-3a909aa72d56 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:37:10.924520 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.compute.server_external_events [req-c4fd36b1-2fde-4f4a-a727-283b73a6837a req-da468c66-268d-4800-a1de-d980b68d884e service nova] Creating event network-vif-deleted:db6b5192-4809-4713-81d9-1ab933f58c63 for instance a4c23b11-fc12-4dd8-8a9c-9019f9e101c9 on hv-cinder-82002 Jul 12 13:37:10.951908 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [req-c4fd36b1-2fde-4f4a-a727-283b73a6837a req-da468c66-268d-4800-a1de-d980b68d884e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084234 Jul 12 13:37:10.955081 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 423/859] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jul 12 13:37:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:37:11.040354 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.policy [None req-e73665c3-bf7e-4ed6-aefc-3a909aa72d56 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b710bbdf0c4d58b4f3ee7ef7410c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8fca4ab6ed466a864c5551fea5f7ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117988) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:37:11.054245 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-e73665c3-bf7e-4ed6-aefc-3a909aa72d56 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] 10.222.0.23 "GET /compute/v2.1/servers/a4c23b11-fc12-4dd8-8a9c-9019f9e101c9" status: 200 len: 1322 microversion: 2.1 time: 0.180697 Jul 12 13:37:11.055722 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 437/860] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:37:10 2022] GET /compute/v2.1/servers/a4c23b11-fc12-4dd8-8a9c-9019f9e101c9 => generated 1322 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:37:12.075866 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-9142fa0d-0b41-4ea3-8718-bc8def5f81e4 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:37:12.077510 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-9142fa0d-0b41-4ea3-8718-bc8def5f81e4 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] [instance: a4c23b11-fc12-4dd8-8a9c-9019f9e101c9] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:37:12.094244 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-9142fa0d-0b41-4ea3-8718-bc8def5f81e4 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:37:12.095020 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-9142fa0d-0b41-4ea3-8718-bc8def5f81e4 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:37:12.098162 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-9142fa0d-0b41-4ea3-8718-bc8def5f81e4 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:37:12.098598 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-9142fa0d-0b41-4ea3-8718-bc8def5f81e4 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:37:12.115583 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.wsgi [None req-9142fa0d-0b41-4ea3-8718-bc8def5f81e4 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] HTTP exception thrown: Instance a4c23b11-fc12-4dd8-8a9c-9019f9e101c9 could not be found. Jul 12 13:37:12.117895 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-9142fa0d-0b41-4ea3-8718-bc8def5f81e4 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Request method failure captured: Jul 12 13:37:12.117895 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: request: GET /compute/v2.1/servers/a4c23b11-fc12-4dd8-8a9c-9019f9e101c9 HTTP/1.1 Jul 12 13:37:12.117895 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: Accept: application/json Jul 12 13:37:12.117895 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: Accept-Encoding: identity Jul 12 13:37:12.117895 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: Connection: close Jul 12 13:37:12.117895 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: Content-Length: 0 Jul 12 13:37:12.117895 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: Content-Type: application/json Jul 12 13:37:12.117895 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: Host: 10.222.0.23 Jul 12 13:37:12.117895 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: Openstack-System-Scope: None Jul 12 13:37:12.117895 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: User-Agent: python-urllib3/1.26.9 Jul 12 13:37:12.117895 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Auth-Token: gAAAAABizXbBhW4StkXvNG_Cn7qDisJAvAnW_dkqPglNj2mdHADqLNjh8gmpsZHQw-9lMAXOZovW8RqWJAIMoLEdIBmdJB4Oe76QieuGy8p7vooe6ChuBQBpEylWoEWoW428MD8SKwQav442J1PRNASZYWuZPdiJj8FvPuAwnE5uWyZgHi61WZg Jul 12 13:37:12.117895 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Domain-Id: None Jul 12 13:37:12.117895 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Domain-Name: None Jul 12 13:37:12.117895 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Identity-Status: Confirmed Jul 12 13:37:12.117895 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Is-Admin-Project: True Jul 12 13:37:12.117895 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Project-Domain-Id: default Jul 12 13:37:12.117895 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Project-Domain-Name: Default Jul 12 13:37:12.117895 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Project-Id: ab8fca4ab6ed466a864c5551fea5f7ff Jul 12 13:37:12.117895 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Project-Name: tempest-AttachVolumeTestJSON-593802314 Jul 12 13:37:12.117895 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Role: reader,member Jul 12 13:37:12.117895 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Roles: reader,member Jul 12 13:37:12.120278 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ab8fca4ab6ed466a864c5551fea5f7ff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ab8fca4ab6ed466a864c5551fea5f7ff", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ab8fca4ab6ed466a864c5551fea5f7ff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ab8fca4ab6ed466a864c5551fea5f7ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] Jul 12 13:37:12.120278 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Tenant: tempest-AttachVolumeTestJSON-593802314 Jul 12 13:37:12.120278 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Tenant-Id: ab8fca4ab6ed466a864c5551fea5f7ff Jul 12 13:37:12.120278 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Tenant-Name: tempest-AttachVolumeTestJSON-593802314 Jul 12 13:37:12.120278 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-User: tempest-AttachVolumeTestJSON-593802314-project Jul 12 13:37:12.120278 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-User-Domain-Id: default Jul 12 13:37:12.120278 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-User-Domain-Name: Default Jul 12 13:37:12.120278 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-User-Id: c4b710bbdf0c4d58b4f3ee7ef7410c0a Jul 12 13:37:12.120278 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-User-Name: tempest-AttachVolumeTestJSON-593802314-project Jul 12 13:37:12.120278 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: method: > Jul 12 13:37:12.120278 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: exception: Instance a4c23b11-fc12-4dd8-8a9c-9019f9e101c9 could not be found. Jul 12 13:37:12.120278 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: action_args: {'id': 'a4c23b11-fc12-4dd8-8a9c-9019f9e101c9'} Jul 12 13:37:12.121765 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 13:37:12.121765 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:37:12.121765 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 13:37:12.121765 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 13:37:12.121765 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 13:37:12.121765 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 13:37:12.121765 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 13:37:12.121765 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 13:37:12.121765 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 13:37:12.121765 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 13:37:12.121765 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4c23b11-fc12-4dd8-8a9c-9019f9e101c9 could not be found. Jul 12 13:37:12.121765 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi Jul 12 13:37:12.121765 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:37:12.121765 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi Jul 12 13:37:12.121765 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:37:12.121765 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:37:12.121765 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:37:12.121765 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 13:37:12.121765 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 13:37:12.121765 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 13:37:12.123203 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:37:12.123203 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 13:37:12.123203 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 13:37:12.123203 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 13:37:12.123203 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 13:37:12.123203 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 13:37:12.123203 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 13:37:12.123203 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4c23b11-fc12-4dd8-8a9c-9019f9e101c9 could not be found. Jul 12 13:37:12.123203 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi Jul 12 13:37:12.123203 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:37:12.123203 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi Jul 12 13:37:12.123203 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:37:12.123203 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:37:12.123203 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:37:12.123203 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 13:37:12.123203 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 13:37:12.123203 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4c23b11-fc12-4dd8-8a9c-9019f9e101c9 could not be found. Jul 12 13:37:12.123203 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi Jul 12 13:37:12.124277 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-9142fa0d-0b41-4ea3-8718-bc8def5f81e4 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Returning 404 to user: Instance a4c23b11-fc12-4dd8-8a9c-9019f9e101c9 could not be found. {{(pid=117987) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 13:37:12.124277 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-9142fa0d-0b41-4ea3-8718-bc8def5f81e4 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] 10.222.0.23 "GET /compute/v2.1/servers/a4c23b11-fc12-4dd8-8a9c-9019f9e101c9" status: 404 len: 111 microversion: 2.1 time: 0.048166 Jul 12 13:37:12.124277 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 424/861] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:37:12 2022] GET /compute/v2.1/servers/a4c23b11-fc12-4dd8-8a9c-9019f9e101c9 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 13:37:12.129344 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-00660d48-c177-4bb6-8564-28297617162a tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Calling method '.version_select at 0x7f76e98ad700>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:37:12.153743 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-00660d48-c177-4bb6-8564-28297617162a tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1756865092" status: 202 len: 0 microversion: 2.1 time: 0.029055 Jul 12 13:37:12.155085 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 438/862] 10.222.0.23 () {58 vars in 1220 bytes} [Tue Jul 12 13:37:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1756865092 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 12 13:37:15.560654 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-66409ddb-d2a9-428e-9580-5523396804d8 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:37:15.561759 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-66409ddb-d2a9-428e-9580-5523396804d8 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] [instance: a4c23b11-fc12-4dd8-8a9c-9019f9e101c9] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:37:15.565767 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG dbcounter [-] [117987] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=1 {{(pid=117987) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:37:15.573002 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-66409ddb-d2a9-428e-9580-5523396804d8 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:37:15.573509 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-66409ddb-d2a9-428e-9580-5523396804d8 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:37:15.574285 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-66409ddb-d2a9-428e-9580-5523396804d8 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:37:15.574945 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-66409ddb-d2a9-428e-9580-5523396804d8 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:37:15.592479 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.wsgi [None req-66409ddb-d2a9-428e-9580-5523396804d8 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] HTTP exception thrown: Instance a4c23b11-fc12-4dd8-8a9c-9019f9e101c9 could not be found. Jul 12 13:37:15.594177 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-66409ddb-d2a9-428e-9580-5523396804d8 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Request method failure captured: Jul 12 13:37:15.594177 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: request: DELETE /compute/v2.1/servers/a4c23b11-fc12-4dd8-8a9c-9019f9e101c9 HTTP/1.1 Jul 12 13:37:15.594177 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: Accept: application/json Jul 12 13:37:15.594177 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: Accept-Encoding: identity Jul 12 13:37:15.594177 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: Connection: close Jul 12 13:37:15.594177 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: Content-Length: 0 Jul 12 13:37:15.594177 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: Content-Type: application/json Jul 12 13:37:15.594177 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: Host: 10.222.0.23 Jul 12 13:37:15.594177 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: Openstack-System-Scope: None Jul 12 13:37:15.594177 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: User-Agent: python-urllib3/1.26.9 Jul 12 13:37:15.594177 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Auth-Token: gAAAAABizXbBhW4StkXvNG_Cn7qDisJAvAnW_dkqPglNj2mdHADqLNjh8gmpsZHQw-9lMAXOZovW8RqWJAIMoLEdIBmdJB4Oe76QieuGy8p7vooe6ChuBQBpEylWoEWoW428MD8SKwQav442J1PRNASZYWuZPdiJj8FvPuAwnE5uWyZgHi61WZg Jul 12 13:37:15.594177 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Domain-Id: None Jul 12 13:37:15.594177 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Domain-Name: None Jul 12 13:37:15.594177 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Identity-Status: Confirmed Jul 12 13:37:15.594177 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Is-Admin-Project: True Jul 12 13:37:15.594177 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Project-Domain-Id: default Jul 12 13:37:15.594177 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Project-Domain-Name: Default Jul 12 13:37:15.594177 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Project-Id: ab8fca4ab6ed466a864c5551fea5f7ff Jul 12 13:37:15.594177 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Project-Name: tempest-AttachVolumeTestJSON-593802314 Jul 12 13:37:15.594177 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Role: reader,member Jul 12 13:37:15.594177 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Roles: reader,member Jul 12 13:37:15.596392 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ab8fca4ab6ed466a864c5551fea5f7ff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ab8fca4ab6ed466a864c5551fea5f7ff", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ab8fca4ab6ed466a864c5551fea5f7ff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ab8fca4ab6ed466a864c5551fea5f7ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] Jul 12 13:37:15.596392 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Tenant: tempest-AttachVolumeTestJSON-593802314 Jul 12 13:37:15.596392 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Tenant-Id: ab8fca4ab6ed466a864c5551fea5f7ff Jul 12 13:37:15.596392 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Tenant-Name: tempest-AttachVolumeTestJSON-593802314 Jul 12 13:37:15.596392 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-User: tempest-AttachVolumeTestJSON-593802314-project Jul 12 13:37:15.596392 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-User-Domain-Id: default Jul 12 13:37:15.596392 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-User-Domain-Name: Default Jul 12 13:37:15.596392 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-User-Id: c4b710bbdf0c4d58b4f3ee7ef7410c0a Jul 12 13:37:15.596392 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-User-Name: tempest-AttachVolumeTestJSON-593802314-project Jul 12 13:37:15.596392 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: method: > Jul 12 13:37:15.596392 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: exception: Instance a4c23b11-fc12-4dd8-8a9c-9019f9e101c9 could not be found. Jul 12 13:37:15.596392 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: action_args: {'id': 'a4c23b11-fc12-4dd8-8a9c-9019f9e101c9'} Jul 12 13:37:15.598002 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 13:37:15.598002 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:37:15.598002 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 13:37:15.598002 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 13:37:15.598002 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 13:37:15.598002 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 13:37:15.598002 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 13:37:15.598002 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 13:37:15.598002 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 13:37:15.598002 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 13:37:15.598002 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4c23b11-fc12-4dd8-8a9c-9019f9e101c9 could not be found. Jul 12 13:37:15.598002 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi Jul 12 13:37:15.598002 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:37:15.598002 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi Jul 12 13:37:15.598002 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:37:15.598002 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:37:15.598002 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:37:15.598002 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 13:37:15.598002 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 13:37:15.598002 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 13:37:15.601116 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:37:15.601116 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 12 13:37:15.601116 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 12 13:37:15.601116 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 12 13:37:15.601116 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 12 13:37:15.601116 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 13:37:15.601116 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 13:37:15.601116 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 13:37:15.601116 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 13:37:15.601116 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4c23b11-fc12-4dd8-8a9c-9019f9e101c9 could not be found. Jul 12 13:37:15.601116 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi Jul 12 13:37:15.601116 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:37:15.601116 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi Jul 12 13:37:15.601116 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:37:15.601116 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:37:15.601116 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:37:15.601116 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 13:37:15.601116 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 13:37:15.601116 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4c23b11-fc12-4dd8-8a9c-9019f9e101c9 could not be found. Jul 12 13:37:15.601116 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi Jul 12 13:37:15.604533 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-66409ddb-d2a9-428e-9580-5523396804d8 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Returning 404 to user: Instance a4c23b11-fc12-4dd8-8a9c-9019f9e101c9 could not be found. {{(pid=117987) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 13:37:15.605682 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-66409ddb-d2a9-428e-9580-5523396804d8 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] 10.222.0.23 "DELETE /compute/v2.1/servers/a4c23b11-fc12-4dd8-8a9c-9019f9e101c9" status: 404 len: 111 microversion: 2.1 time: 0.048798 Jul 12 13:37:15.607168 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 425/863] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 12 13:37:15 2022] DELETE /compute/v2.1/servers/a4c23b11-fc12-4dd8-8a9c-9019f9e101c9 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 13:37:15.616796 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-98809f4f-9580-47e6-872c-5e44b9e7e78d tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:37:15.618416 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-98809f4f-9580-47e6-872c-5e44b9e7e78d tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] [instance: a4c23b11-fc12-4dd8-8a9c-9019f9e101c9] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:37:15.630718 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-98809f4f-9580-47e6-872c-5e44b9e7e78d tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:37:15.631166 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-98809f4f-9580-47e6-872c-5e44b9e7e78d tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:37:15.631951 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-98809f4f-9580-47e6-872c-5e44b9e7e78d tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:37:15.632383 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-98809f4f-9580-47e6-872c-5e44b9e7e78d tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:37:15.658854 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.wsgi [None req-98809f4f-9580-47e6-872c-5e44b9e7e78d tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] HTTP exception thrown: Instance a4c23b11-fc12-4dd8-8a9c-9019f9e101c9 could not be found. Jul 12 13:37:15.660729 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-98809f4f-9580-47e6-872c-5e44b9e7e78d tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Request method failure captured: Jul 12 13:37:15.660729 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: request: GET /compute/v2.1/servers/a4c23b11-fc12-4dd8-8a9c-9019f9e101c9 HTTP/1.1 Jul 12 13:37:15.660729 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: Accept: application/json Jul 12 13:37:15.660729 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: Accept-Encoding: identity Jul 12 13:37:15.660729 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: Connection: close Jul 12 13:37:15.660729 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: Content-Length: 0 Jul 12 13:37:15.660729 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: Content-Type: application/json Jul 12 13:37:15.660729 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: Host: 10.222.0.23 Jul 12 13:37:15.660729 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: Openstack-System-Scope: None Jul 12 13:37:15.660729 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: User-Agent: python-urllib3/1.26.9 Jul 12 13:37:15.660729 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Auth-Token: gAAAAABizXbBhW4StkXvNG_Cn7qDisJAvAnW_dkqPglNj2mdHADqLNjh8gmpsZHQw-9lMAXOZovW8RqWJAIMoLEdIBmdJB4Oe76QieuGy8p7vooe6ChuBQBpEylWoEWoW428MD8SKwQav442J1PRNASZYWuZPdiJj8FvPuAwnE5uWyZgHi61WZg Jul 12 13:37:15.660729 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Domain-Id: None Jul 12 13:37:15.660729 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Domain-Name: None Jul 12 13:37:15.660729 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Identity-Status: Confirmed Jul 12 13:37:15.660729 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Is-Admin-Project: True Jul 12 13:37:15.660729 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Project-Domain-Id: default Jul 12 13:37:15.660729 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Project-Domain-Name: Default Jul 12 13:37:15.660729 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Project-Id: ab8fca4ab6ed466a864c5551fea5f7ff Jul 12 13:37:15.660729 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Project-Name: tempest-AttachVolumeTestJSON-593802314 Jul 12 13:37:15.660729 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Role: reader,member Jul 12 13:37:15.660729 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Roles: reader,member Jul 12 13:37:15.662200 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ab8fca4ab6ed466a864c5551fea5f7ff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ab8fca4ab6ed466a864c5551fea5f7ff", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ab8fca4ab6ed466a864c5551fea5f7ff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ab8fca4ab6ed466a864c5551fea5f7ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] Jul 12 13:37:15.662200 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Tenant: tempest-AttachVolumeTestJSON-593802314 Jul 12 13:37:15.662200 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Tenant-Id: ab8fca4ab6ed466a864c5551fea5f7ff Jul 12 13:37:15.662200 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Tenant-Name: tempest-AttachVolumeTestJSON-593802314 Jul 12 13:37:15.662200 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-User: tempest-AttachVolumeTestJSON-593802314-project Jul 12 13:37:15.662200 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-User-Domain-Id: default Jul 12 13:37:15.662200 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-User-Domain-Name: Default Jul 12 13:37:15.662200 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-User-Id: c4b710bbdf0c4d58b4f3ee7ef7410c0a Jul 12 13:37:15.662200 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-User-Name: tempest-AttachVolumeTestJSON-593802314-project Jul 12 13:37:15.662200 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: method: > Jul 12 13:37:15.662200 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: exception: Instance a4c23b11-fc12-4dd8-8a9c-9019f9e101c9 could not be found. Jul 12 13:37:15.662200 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: action_args: {'id': 'a4c23b11-fc12-4dd8-8a9c-9019f9e101c9'} Jul 12 13:37:15.662919 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 13:37:15.662919 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:37:15.662919 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 13:37:15.662919 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 13:37:15.662919 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 13:37:15.662919 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 13:37:15.662919 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 13:37:15.662919 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 13:37:15.662919 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 13:37:15.662919 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 13:37:15.662919 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4c23b11-fc12-4dd8-8a9c-9019f9e101c9 could not be found. Jul 12 13:37:15.662919 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi Jul 12 13:37:15.662919 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:37:15.662919 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi Jul 12 13:37:15.662919 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:37:15.662919 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:37:15.662919 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:37:15.662919 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 13:37:15.662919 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 13:37:15.662919 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 13:37:15.664114 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:37:15.664114 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 13:37:15.664114 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 13:37:15.664114 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 13:37:15.664114 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 13:37:15.664114 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 13:37:15.664114 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 13:37:15.664114 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4c23b11-fc12-4dd8-8a9c-9019f9e101c9 could not be found. Jul 12 13:37:15.664114 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi Jul 12 13:37:15.664114 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:37:15.664114 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi Jul 12 13:37:15.664114 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:37:15.664114 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:37:15.664114 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:37:15.664114 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 13:37:15.664114 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 13:37:15.664114 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4c23b11-fc12-4dd8-8a9c-9019f9e101c9 could not be found. Jul 12 13:37:15.664114 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi Jul 12 13:37:15.666748 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-98809f4f-9580-47e6-872c-5e44b9e7e78d tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Returning 404 to user: Instance a4c23b11-fc12-4dd8-8a9c-9019f9e101c9 could not be found. {{(pid=117988) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 13:37:15.667690 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-98809f4f-9580-47e6-872c-5e44b9e7e78d tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] 10.222.0.23 "GET /compute/v2.1/servers/a4c23b11-fc12-4dd8-8a9c-9019f9e101c9" status: 404 len: 111 microversion: 2.1 time: 0.055993 Jul 12 13:37:15.668638 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 439/864] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:37:15 2022] GET /compute/v2.1/servers/a4c23b11-fc12-4dd8-8a9c-9019f9e101c9 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 13:37:16.843300 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-187ff7bb-672a-481d-8585-9415350763c9 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Calling method '>' {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:37:16.844457 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.compute.api [None req-187ff7bb-672a-481d-8585-9415350763c9 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] [instance: eeb0b554-cd09-49b5-95f0-22fc7c707944] Fetching instance by UUID {{(pid=117987) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:37:16.852096 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-187ff7bb-672a-481d-8585-9415350763c9 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:37:16.852877 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-187ff7bb-672a-481d-8585-9415350763c9 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:37:16.854438 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-187ff7bb-672a-481d-8585-9415350763c9 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:37:16.855183 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG oslo_concurrency.lockutils [None req-187ff7bb-672a-481d-8585-9415350763c9 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:37:16.870592 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.wsgi [None req-187ff7bb-672a-481d-8585-9415350763c9 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] HTTP exception thrown: Instance eeb0b554-cd09-49b5-95f0-22fc7c707944 could not be found. Jul 12 13:37:16.872502 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-187ff7bb-672a-481d-8585-9415350763c9 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Request method failure captured: Jul 12 13:37:16.872502 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: request: DELETE /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944 HTTP/1.1 Jul 12 13:37:16.872502 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: Accept: application/json Jul 12 13:37:16.872502 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: Accept-Encoding: identity Jul 12 13:37:16.872502 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: Connection: close Jul 12 13:37:16.872502 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: Content-Length: 0 Jul 12 13:37:16.872502 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: Content-Type: application/json Jul 12 13:37:16.872502 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: Host: 10.222.0.23 Jul 12 13:37:16.872502 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: Openstack-System-Scope: None Jul 12 13:37:16.872502 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: User-Agent: python-urllib3/1.26.9 Jul 12 13:37:16.872502 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Auth-Token: gAAAAABizXbBhW4StkXvNG_Cn7qDisJAvAnW_dkqPglNj2mdHADqLNjh8gmpsZHQw-9lMAXOZovW8RqWJAIMoLEdIBmdJB4Oe76QieuGy8p7vooe6ChuBQBpEylWoEWoW428MD8SKwQav442J1PRNASZYWuZPdiJj8FvPuAwnE5uWyZgHi61WZg Jul 12 13:37:16.872502 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Domain-Id: None Jul 12 13:37:16.872502 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Domain-Name: None Jul 12 13:37:16.872502 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Identity-Status: Confirmed Jul 12 13:37:16.872502 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Is-Admin-Project: True Jul 12 13:37:16.872502 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Project-Domain-Id: default Jul 12 13:37:16.872502 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Project-Domain-Name: Default Jul 12 13:37:16.872502 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Project-Id: ab8fca4ab6ed466a864c5551fea5f7ff Jul 12 13:37:16.872502 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Project-Name: tempest-AttachVolumeTestJSON-593802314 Jul 12 13:37:16.872502 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Role: reader,member Jul 12 13:37:16.872502 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Roles: reader,member Jul 12 13:37:16.874606 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ab8fca4ab6ed466a864c5551fea5f7ff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ab8fca4ab6ed466a864c5551fea5f7ff", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ab8fca4ab6ed466a864c5551fea5f7ff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ab8fca4ab6ed466a864c5551fea5f7ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] Jul 12 13:37:16.874606 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Tenant: tempest-AttachVolumeTestJSON-593802314 Jul 12 13:37:16.874606 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Tenant-Id: ab8fca4ab6ed466a864c5551fea5f7ff Jul 12 13:37:16.874606 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-Tenant-Name: tempest-AttachVolumeTestJSON-593802314 Jul 12 13:37:16.874606 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-User: tempest-AttachVolumeTestJSON-593802314-project Jul 12 13:37:16.874606 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-User-Domain-Id: default Jul 12 13:37:16.874606 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-User-Domain-Name: Default Jul 12 13:37:16.874606 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-User-Id: c4b710bbdf0c4d58b4f3ee7ef7410c0a Jul 12 13:37:16.874606 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: X-User-Name: tempest-AttachVolumeTestJSON-593802314-project Jul 12 13:37:16.874606 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: method: > Jul 12 13:37:16.874606 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: exception: Instance eeb0b554-cd09-49b5-95f0-22fc7c707944 could not be found. Jul 12 13:37:16.874606 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: action_args: {'id': 'eeb0b554-cd09-49b5-95f0-22fc7c707944'} Jul 12 13:37:16.875497 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: {{(pid=117987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 13:37:16.875497 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:37:16.875497 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 13:37:16.875497 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 13:37:16.875497 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 13:37:16.875497 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 13:37:16.875497 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 13:37:16.875497 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 13:37:16.875497 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 13:37:16.875497 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 13:37:16.875497 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eeb0b554-cd09-49b5-95f0-22fc7c707944 could not be found. Jul 12 13:37:16.875497 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi Jul 12 13:37:16.875497 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:37:16.875497 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi Jul 12 13:37:16.875497 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:37:16.875497 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:37:16.875497 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:37:16.875497 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 13:37:16.875497 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 13:37:16.875497 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 13:37:16.877549 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:37:16.877549 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 12 13:37:16.877549 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 12 13:37:16.877549 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 12 13:37:16.877549 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 12 13:37:16.877549 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 13:37:16.877549 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 13:37:16.877549 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 13:37:16.877549 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 13:37:16.877549 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eeb0b554-cd09-49b5-95f0-22fc7c707944 could not be found. Jul 12 13:37:16.877549 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi Jul 12 13:37:16.877549 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:37:16.877549 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi Jul 12 13:37:16.877549 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:37:16.877549 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:37:16.877549 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:37:16.877549 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 13:37:16.877549 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 13:37:16.877549 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eeb0b554-cd09-49b5-95f0-22fc7c707944 could not be found. Jul 12 13:37:16.877549 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: ERROR nova.api.openstack.wsgi Jul 12 13:37:16.882547 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: DEBUG nova.api.openstack.wsgi [None req-187ff7bb-672a-481d-8585-9415350763c9 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Returning 404 to user: Instance eeb0b554-cd09-49b5-95f0-22fc7c707944 could not be found. {{(pid=117987) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 13:37:16.882547 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO nova.api.openstack.requestlog [None req-187ff7bb-672a-481d-8585-9415350763c9 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] 10.222.0.23 "DELETE /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944" status: 404 len: 111 microversion: 2.1 time: 0.034605 Jul 12 13:37:16.882547 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: [pid: 117987|app: 0|req: 426/865] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jul 12 13:37:16 2022] DELETE /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 13:37:16.884646 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-1cff6294-f8f0-4008-bc01-e928468405e5 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Calling method '>' {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:37:16.885370 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.compute.api [None req-1cff6294-f8f0-4008-bc01-e928468405e5 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] [instance: eeb0b554-cd09-49b5-95f0-22fc7c707944] Fetching instance by UUID {{(pid=117988) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:37:16.893407 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-1cff6294-f8f0-4008-bc01-e928468405e5 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:37:16.894319 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-1cff6294-f8f0-4008-bc01-e928468405e5 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:37:16.895244 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-1cff6294-f8f0-4008-bc01-e928468405e5 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:37:16.895768 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG oslo_concurrency.lockutils [None req-1cff6294-f8f0-4008-bc01-e928468405e5 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Lock "1699b324-b37f-4b24-822a-271bd58456f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:37:16.912617 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.wsgi [None req-1cff6294-f8f0-4008-bc01-e928468405e5 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] HTTP exception thrown: Instance eeb0b554-cd09-49b5-95f0-22fc7c707944 could not be found. Jul 12 13:37:16.914386 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-1cff6294-f8f0-4008-bc01-e928468405e5 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Request method failure captured: Jul 12 13:37:16.914386 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: request: GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944 HTTP/1.1 Jul 12 13:37:16.914386 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: Accept: application/json Jul 12 13:37:16.914386 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: Accept-Encoding: identity Jul 12 13:37:16.914386 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: Connection: close Jul 12 13:37:16.914386 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: Content-Length: 0 Jul 12 13:37:16.914386 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: Content-Type: application/json Jul 12 13:37:16.914386 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: Host: 10.222.0.23 Jul 12 13:37:16.914386 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: Openstack-System-Scope: None Jul 12 13:37:16.914386 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: User-Agent: python-urllib3/1.26.9 Jul 12 13:37:16.914386 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Auth-Token: gAAAAABizXbBhW4StkXvNG_Cn7qDisJAvAnW_dkqPglNj2mdHADqLNjh8gmpsZHQw-9lMAXOZovW8RqWJAIMoLEdIBmdJB4Oe76QieuGy8p7vooe6ChuBQBpEylWoEWoW428MD8SKwQav442J1PRNASZYWuZPdiJj8FvPuAwnE5uWyZgHi61WZg Jul 12 13:37:16.914386 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Domain-Id: None Jul 12 13:37:16.914386 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Domain-Name: None Jul 12 13:37:16.914386 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Identity-Status: Confirmed Jul 12 13:37:16.914386 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Is-Admin-Project: True Jul 12 13:37:16.914386 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Project-Domain-Id: default Jul 12 13:37:16.914386 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Project-Domain-Name: Default Jul 12 13:37:16.914386 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Project-Id: ab8fca4ab6ed466a864c5551fea5f7ff Jul 12 13:37:16.914386 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Project-Name: tempest-AttachVolumeTestJSON-593802314 Jul 12 13:37:16.914386 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Role: reader,member Jul 12 13:37:16.914386 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Roles: reader,member Jul 12 13:37:16.915890 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ab8fca4ab6ed466a864c5551fea5f7ff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ab8fca4ab6ed466a864c5551fea5f7ff", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ab8fca4ab6ed466a864c5551fea5f7ff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ab8fca4ab6ed466a864c5551fea5f7ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] Jul 12 13:37:16.915890 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Tenant: tempest-AttachVolumeTestJSON-593802314 Jul 12 13:37:16.915890 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Tenant-Id: ab8fca4ab6ed466a864c5551fea5f7ff Jul 12 13:37:16.915890 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-Tenant-Name: tempest-AttachVolumeTestJSON-593802314 Jul 12 13:37:16.915890 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-User: tempest-AttachVolumeTestJSON-593802314-project Jul 12 13:37:16.915890 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-User-Domain-Id: default Jul 12 13:37:16.915890 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-User-Domain-Name: Default Jul 12 13:37:16.915890 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-User-Id: c4b710bbdf0c4d58b4f3ee7ef7410c0a Jul 12 13:37:16.915890 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: X-User-Name: tempest-AttachVolumeTestJSON-593802314-project Jul 12 13:37:16.915890 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: method: > Jul 12 13:37:16.915890 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: exception: Instance eeb0b554-cd09-49b5-95f0-22fc7c707944 could not be found. Jul 12 13:37:16.915890 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: action_args: {'id': 'eeb0b554-cd09-49b5-95f0-22fc7c707944'} Jul 12 13:37:16.916708 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: {{(pid=117988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 13:37:16.916708 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:37:16.916708 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 13:37:16.916708 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 13:37:16.916708 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 13:37:16.916708 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 13:37:16.916708 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 13:37:16.916708 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 13:37:16.916708 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 13:37:16.916708 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 13:37:16.916708 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eeb0b554-cd09-49b5-95f0-22fc7c707944 could not be found. Jul 12 13:37:16.916708 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi Jul 12 13:37:16.916708 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:37:16.916708 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi Jul 12 13:37:16.916708 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:37:16.916708 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:37:16.916708 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:37:16.916708 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 13:37:16.916708 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 13:37:16.916708 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 13:37:16.918147 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:37:16.918147 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 13:37:16.918147 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 13:37:16.918147 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 13:37:16.918147 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 13:37:16.918147 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 13:37:16.918147 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 13:37:16.918147 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eeb0b554-cd09-49b5-95f0-22fc7c707944 could not be found. Jul 12 13:37:16.918147 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi Jul 12 13:37:16.918147 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:37:16.918147 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi Jul 12 13:37:16.918147 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:37:16.918147 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:37:16.918147 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:37:16.918147 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 13:37:16.918147 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 13:37:16.918147 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eeb0b554-cd09-49b5-95f0-22fc7c707944 could not be found. Jul 12 13:37:16.918147 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: ERROR nova.api.openstack.wsgi Jul 12 13:37:16.919432 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: DEBUG nova.api.openstack.wsgi [None req-1cff6294-f8f0-4008-bc01-e928468405e5 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] Returning 404 to user: Instance eeb0b554-cd09-49b5-95f0-22fc7c707944 could not be found. {{(pid=117988) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 13:37:16.919432 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO nova.api.openstack.requestlog [None req-1cff6294-f8f0-4008-bc01-e928468405e5 tempest-AttachVolumeTestJSON-593802314 tempest-AttachVolumeTestJSON-593802314-project] 10.222.0.23 "GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944" status: 404 len: 111 microversion: 2.1 time: 0.037476 Jul 12 13:37:16.919432 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: [pid: 117988|app: 0|req: 440/866] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jul 12 13:37:16 2022] GET /compute/v2.1/servers/eeb0b554-cd09-49b5-95f0-22fc7c707944 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 12 13:37:23.309997 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 12 13:37:23.310626 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: Tue Jul 12 13:37:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 12 13:39:21.523216 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 12 13:39:21.524113 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: Tue Jul 12 13:39:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 12 13:39:21.574228 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 12 13:39:21.574819 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: Tue Jul 12 13:39:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 12 13:39:47.727218 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 12 13:39:47.727878 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: Tue Jul 12 13:39:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 12 13:40:43.320610 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 12 13:40:43.321085 dv-cinder-820027-10-iscsi devstack@n-api.service[117987]: Tue Jul 12 13:40:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 12 13:42:33.924534 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 12 13:42:33.925632 dv-cinder-820027-10-iscsi devstack@n-api.service[117988]: Tue Jul 12 13:42:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!